Platform - Ingest - Senior Software Engineer (Java/Ruby)

Full Time
2 months ago

Elastic is a free and open search company that powers enterprise search, observability, and security solutions built on one technology stack that can be deployed anywhere. From finding documents to monitoring infrastructure to hunting for threats, Elastic makes data usable in real-time and at scale. Thousands of organizations worldwide, including Barclays, Cisco, eBay, Fairfax, ING, Goldman Sachs, Microsoft, The Mayo Clinic, NASA, The New York Times, Wikipedia, and Verizon, use Elastic to power mission-critical systems. Founded in 2012, Elastic is a distributed company with Elasticians around the globe. Learn more at elastic.co.

The Platform Ingest team at Elastic build tools to collect and ingest data easily, efficiently, and quickly. Learn more about them on our website here or by testing the data ingestion user experience yourself on Elastic Cloud. We are responsible for Elastic Agent as a unified data collector for Elastic solutions, Fleet as a central management platform, Integrations platform as a marketplace experience to discover and build third party integrations to bring data into the Elastic Stack, and the data transformation and processing tooling of Logstash, ingest pipelines and runtime fields. We are also working to embed the OpenTelemetry collector within the Elastic Stack to promote data interoperability and enable OTel users to get the benefit of Elastic’s battle-tested visualizations, analytics, and machine learning capabilities.

As an Engineer on the Logstash/Data Processing team, you will be part of a team working on development of the core Logstash platform and plugins, and contributing to the OpenTelemetry collector.

The Logstash project is an open source streaming ETL (extract-transform-load) tool that collects data from multiple sources, reshaping and enriching it, and pushing it to multiple destinations. It is structured around a set of more than 200 plugins and a core platform that wires these plugins together into one or multiple continuously processing pipelines. The project is written in a mix of JRuby and Java.

Our team is small and distributed across the globe, and we communicate mostly through Slack, GitHub, email and Zoom.

What you'll be doing:
  • Designing and implementing new features for Logstash and its plugins in Java and JRuby.
  • Maintaining, updating and improving existing code and dependencies while ensuring automated test coverage.
  • Adding new features, and making contributions to the Open Telemetry Collector.
  • Engaging with multiple public GitHub repositories and community forums.
  • Providing Pull Request reviews and guidance to your peers.
  • Caring for the needs of our users and enterprise customers.
  • Collaborating with other teams to drive product goals.
  • Working together with the support organization to help our customers.
What you'll bring:
  • Ability to work in a remote-first environment, with excellent verbal and written communication.
  • Critical thinking, positivity, autonomy and adaptability.
  • A track record of developing distributed applications, preferably in Java and/or Ruby, and willingness to learn additional languages.
  • Experience with test-driven development and/or software delivery, backed by comprehensive testing, continuous integration, and automation.
  • Experience in back-end distributed application development (cloud, orchestration, Linux/Windows services, etc).
  • Knowledge of stream processing platforms (such as Kafka), database technologies (e.g., Postgres or MySQL) and network technologies (e.g., TCP, UDP and HTTP).
  • 5+ years of industry experience.
What would help:
  • Hands-on experience with Docker and Kubernetes.
  • Exposure to the Elastic stack.
  • Go development.
  • Open source software development.
  • Experience with or interest in OpenTelemetry.
Additional Information - We Take Care of Our People

As a distributed company, diversity drives our identity. Whether you’re looking to launch a new career or grow an existing one, Elastic is the type of company where you can balance great work with great life. Your age is only a number. It doesn’t matter if you’re just out of college or your children are; we need you for what you can do.

We strive to have parity of benefits across regions and while regulations differ from place to place, we believe taking care of our people is the right thing to do.

  • Competitive pay based on the work you do here and not your previous salary
  • Health coverage for you and your family in many locations
  • Ability to craft your calendar with flexible locations and schedules for many roles
  • Generous number of vacation days each year
  • Increase your impact - We match up to $2000 (or local currency equivalent) for financial donations and service
  • Up to 40 hours each year to use toward volunteer projects you love
  • Embracing parenthood with minimum of 16 weeks of parental leave

Different people approach problems differently. We need that. Elastic is an equal opportunity/affirmative action employer committed to diversity, equity, and inclusion. Qualified applicants will receive consideration for employment without regard to race, ethnicity, color, religion, sex, pregnancy, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, disability status, or any other basis protected by federal, state or local law, ordinance or regulation.

We welcome individuals with disabilities and strive to create an accessible and inclusive experience for all individuals. To request an accommodation during the application or the recruiting process, please email candidate_accessibility@elastic.co We will reply to your request within 24 business hours of submission.

Applicants have rights under Federal Employment Laws, view posters linked below: Family and Medical Leave Act (FMLA) Poster; Pay Transparency Nondiscrimination Provision Poster; Employee Polygraph Protection Act (EPPA) Poster and Know Your Rights (Poster)

Elasticsearch develops and distributes encryption software and technology that is subject to U.S. export controls and licensing requirements for individuals who are located in or are nationals of the following sanctioned countries and regions: Belarus, Cuba, Iran, North Korea, Russia, Syria, the Crimea Region of Ukraine, the Donetsk People’s Republic (“DNR”), and the Luhansk People’s Republic (“LNR”). If you are located in or are a national of one of the listed countries or regions, an export license may be required as a condition of your employment in this role. Please note that national origin and/or nationality do not affect eligibility for employment with Elastic.

Please see here for our Privacy Statement.