Principal Java Engineer - Distributed Systems, Serverless - Elasticsearch

Contract type
Ongoing
Work mode
Remote
Experience
Lead / principal · Not stated

Level inferred from job title

Job description

Principal Software Engineer on the Elasticsearch - Distributed Systems team, focused on how Elasticsearch provides scale, performance, and resilience, especially for the Serverless offering. The role tackles deep distributed systems challenges in node communication and in how data is indexed, allocated, and managed across nodes.

At a glance

Work mode
Remote
Languages
English

What you'll do

  • Leveraging deep distributed systems expertise to design, build, and operate core pieces of the next-generation Serverless Elasticsearch offering, directly impacting the experience of customers worldwide.
  • Improving Elasticsearch's components that support concurrent and consistent indexing across multiple machines.
  • Maintaining the cluster coordination system to keep performance high even though nodes come and go from the cluster and data moves around, while maintaining the safety and liveness properties of the system as a whole.
  • Pushing the limits on the number of shards, nodes, and petabytes that Elasticsearch can handle today.
  • Looking into all kinds of issues, including performance or concurrency issues, and proposing solutions.
  • Supporting support engineers with the harder problems.
  • Owning operational investigations end-to-end, until performance or stability issues are successfully resolved.

What we're looking for

  • Deep background in distributed systems and consensus algorithms.
  • Strong skills in core Java and conversant in the standard library of data structures and concurrency constructs, as well as newer language features.
  • Deep technical proficiency in algorithms.
  • Experience building large-scale distributed systems, rather than making use of off-the-shelf services.
  • Experience building and debugging complex features with a broad impact, running on multiple machines.
  • Able to own projects from beginning to end, covering both technical design and working with others to develop needed components.
  • Experience managing projects involving multiple engineers.
  • Proven track record of using AI to accelerate development, debug complex systems, and optimize code, while still owning the final outcomes.
  • Ability to collaborate across functions and teams and seamlessly transition between different projects, codebases, or teams based on business priorities.
  • Can work autonomously, drive decisions and results in a distributed team by leveraging asynchronous, direct, and transparent communication.

Nice to have

  • Data stores
  • Search, analytics, Lucene
  • Strong knowledge of the JDK
  • Asynchronous event-driven network frameworks such as Netty

Your team

Elasticsearch - Distributed Systems team

Focuses on how Elasticsearch provides scale, performance, and resilience, especially in the context of the Serverless offering.

Benefits

  • Competitive pay based on the work you do here and not your previous salary
  • Health coverage for you and your family in many locations
  • Ability to craft your calendar with flexible locations and schedules for many roles
  • Generous number of vacation days each year
  • Increase your impact - We match up to $2000 (or local currency equivalent) for financial donations and service
  • Up to 40 hours each year to use toward volunteer projects you love
  • Embracing parenthood with minimum of 16 weeks of parental leave

Apply

About Elastic

The Search AI Company

The Elastic Search AI Platform, used by more than 50% of the Fortune 500, brings together the precision of search and the intelligence of AI to enable everyone to accelerate the results that matter. By taking advantage of all structured and unstructured data — securing and protecting private information more effectively — Elastic's complete, cloud-based solutions for search, security, and observability help organizations deliver on the promise of AI.

Mission

Enables everyone to find the answers they need in real time, using all their data, at scale — unleashing the potential of businesses and people.

Key facts

  • The Elastic Search AI Platform is used by more than 50% of the Fortune 500
  • Distributed company
  • Offers complete, cloud-based solutions for search, security, and observability

What they value

  • Diversity drives our identity
  • Balance great work with great life
  • Parity of benefits across regions
  • Accessible and inclusive experience for all individuals