Staff Software Engineer - Internal Observability

Full Time
New York, NY, USA
8 months ago

Fastly helps people stay better connected with the things they love. Fastly’s edge cloud platform enables customers to create great digital experiences quickly, securely, and reliably by processing, serving, and securing our customers’ applications as close to their end-users as possible — at the edge of the Internet. The platform is designed to take advantage of the modern internet, to be programmable, and to support agile software development. Fastly’s customers include many of the world’s most prominent companies, including Vimeo, Pinterest, The New York Times, and GitHub.

We're building a more trustworthy Internet. Come join us.

Fastly’s Foundation Engineering Observability team is looking for a Staff Software Engineer who is passionate about building, scaling, and automating our internal platforms to provide global visibility to the health and performance of our networks . You will be working alongside other engineering and support teams, to provide insights and recommendations on how we make our services and software stacks more observable. Your focus in logging, metrics, distributed tracing and monitoring will be vital in this role to help Fastly grow our observability platforms.

What You'll Do:

  • Focus on improving and scaling our logging pipelines, telemetry collection, and monitoring systems
  • Improve the performance and reliability of the observability platform infrastructure
  • Create and instrument critical business metrics for insights and transparency
  • Collaborate with other Fastly engineers to implement solutions that deliver value for our internal customer teams
  • You’ll participate in incident reviews to build improved alerts for detection and potential proactive mitigations

What We're Looking For: 

  • Extensive experience scaling out Prometheus architecture i.e. you are not just a user of Prometheus but have actually built the underlying infrastructure
  • Comfortable working with tools like OpenTelemetry, Grafana, Loki, Tempo, and Mimir
  • Extensive experience working with Linux operating systems focusing on metric collection and instrumentation
  • Implementing and scaling observability pipelines using self-managed, on premises, and open source software
  • Experience developing automation, orchestrations, and writing infrastructure as code for platform management
  • Comfortable working with scripting and interpreted languages, and test driven development
  • Excellent communication and listening skills, as well as a high degree of emotional intelligence

We’ll be super impressed if you have experience in any of these: 

  • Deep understanding of challenges with high cardinality, churn, data volumes to anticipate capacity needs 
  • A track record of working across multiple cloud platforms and physical environments to provide global visibility
  • Experience working with Clickhouse for time series data
  • Development of metrics exporters for the Prometheus ecosystem

Work Hours: 

  • This position will require you to be available during core business hours
  • You’ll participate in a on-call rotation to support platform availability

Work Locations & Travel Requirements: 

This position is open to the following preferred office locations:

  • San Francisco, CA
  • Culver City, CA
  • Denver, CO
  • New York, NY

Fastly currently embraces a largely hybrid model for most roles which allows employees flexibility to split their time between the office and home. 

Salary: 

The estimated salary range for this position is $167,790 to $209,740.

Starting salary may vary based on permissible, non-discriminatory factors such as experience, skills, qualifications, and location.

This role may be eligible to participate in Fastly’s equity and discretionary bonus programs.

Benefits:

We care about you. Fastly works hard to create a positive environment for our employees, and we think your life outside of work is important too. We support our teams with great benefits that start on the first day of your employment with Fastly. Curious about our offerings? 

We offer a comprehensive benefits package including medical, dental, and vision insurance. Family planning, mental health support along with Employee Assistance Program, Insurance (Life, Disability, and Accident), a Flexible Vacation policy and up to 18 days of accrued paid sick leave are there to help support our employees. We also offer 401(k) (including company match) and an Employee Stock Purchase Program. For 2024, we offer 10 paid local holidays, 11 paid company wellness days. 

 

Why Fastly?

  • We have a huge impact. Fastly is a small company with a big reach. Not only do our customers have a tremendous user base, but we also support a growing number of open source projects and initiatives. Outside of code, employees are encouraged to share causes close to their heart with others so we can help lend a supportive hand.

  • We love distributed teams. Fastly’s home-base is in San Francisco, but we have multiple offices and employees sprinkled around the globe. As a new hire, you will be able to attend our IN-PERSON new hire orientation in our San Francisco office! It is an exciting week-long experience that we offer to new employees to build connections with colleagues across Fastly, participate in hands-on learning opportunities, and immerse yourself in our culture firsthand. 

  • We value diversity. Growing and maintaining our inclusive and diverse team matters to us. We are committed to being a company where our employees feel comfortable bringing their authentic selves to work and have the ability to be successful -- every day.

  • We are passionate. Fastly is chock full of passionate people and we’re not ‘one size fits all’. Fastly employs authors, pilots, skiers, parents (of humans and animals), makeup geeks, coffee connoisseurs, and more. We love employees for who they are and what they are passionate about.

We’re always looking for humble, sharp, and creative folks to join the Fastly team. If you think you might be a fit please apply! A fully completed application and resume or CV are required when applying.

Fastly is committed to ensuring equal employment opportunity and to providing employees with a safe and welcoming work environment free of discrimination and harassment. Our employment decisions are based on business needs, job requirements and individual qualifications. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, family or parental status, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances.

Consistent with the Americans with Disabilities Act (ADA) and federal or state disability laws, Fastly will provide reasonable accommodations for applicants and employees with disabilities. If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and/or to receive other benefits and privileges of employment, please contact your Recruiter, or the Fastly Employee Relations team at candidateaccommodations@fastly.com or 501-287-4901. 

Fastly collects and processes personal data submitted by job applicants in accordance with our Privacy Policy. Please see our privacy notice for job applicants.