Software Engineer – AI

Full Time
San Francisco, CA, USA
1 day ago

About Us:  

We love going to work and think you should too. Our team is dedicated to trust, customer obsession, agility, and striving to be better everyday. These values serve as the foundation of our culture, guiding our actions and driving us towards excellence. We foster a culture of performance and recognition, allowing us to transform growth as we enable our employees to do the best work of their careers.

This role is open to candidates based in or near San Francisco, CA. At LogicMonitor, we hire within our Centers of Energy—vibrant locations where our teams connect, collaborate, and innovate.

To learn more about life at LogicMonitor, check out our Careers Page.

What You'll Do:

LM Envision, LogicMonitor's leading hybrid observability platform powered by AI, helps modern enterprises gain operational visibility into and predictability across their IT stacks, so they can continue to deliver extraordinary employee and customer experiences. LogicMonitor has a layered approach to intelligence, where AI and Machine Learning is baked into every facet of the LM Envision platform to help IT teams improve efficiency, minimize alert fatigue, proactively predict trends, and maximize enterprise growth and transformation. 

Our customers love LogicMonitor's ability to bring cloud and traditional IT together into one view, as seen in minimal churn rates, expansion business, and exciting new customer references. In fact, LogicMonitor has received the highest Net Promoter Score of any IT Infrastructure Management provider. LogicMonitor also boasts high employee satisfaction. We have been certified as a Great Place To Work®, and named one of BuiltIn's Best Places to Work for the seventh year in a row! 

LogicMonitor is advancing observability through AI‑driven data intelligence, connecting massive telemetry streams with the reasoning capabilities of large language models. We’re looking for a Software Engineer who sits at the intersection of backend systems and data engineering, capable of building scalable data pipelines, APIs, and retrieval frameworks that fuel Edwin AI, Dexda, and other AIOps products. You’ll design, build, and optimize the data infrastructure that makes GenAI‑powered insights reliable, explainable, and real‑time.

Here's a closer look at this key role:

  • Design and build streaming and batch data pipelines that process metrics, logs, and events for AI workflows.
  • Develop ETL and feature‑extraction pipelines using Python and Java microservices.
  • Integrate data ingestion and enrichment from multiple observability sources into AI‑ready formats.
  • Build resilient data orchestration using Kafka, Airflow, and Redis Streams.
  • Implement retrieval‑augmented generation (RAG) pipelines with vector databases (Milvus, Qdrant, OpenSearch, Neo4j Vector).
  • Develop data indexing and semantic search for large‑scale observability and operational data.
  • Work with structured and unstructured data lakes and warehouses (Delta Lake, Iceberg, ClickHouse).
  • Collaborate with the AI Platform team to manage embeddings, metadata, and model context storage.
  • Optimize latency and throughput for retrieval, query expansion, and AI response generation.
  • Build and maintain Java microservices (Spring Boot) that serve AI and analytics data to Edwin and AIOps applications.
  • Develop Python APIs (FastAPI / LangGraph) for LLM orchestration, summarization, and correlation reasoning.
  • Implement schema contracts and streaming protocols (REST, gRPC, SSE, WebSockets) between services.
  • Ensure fault‑tolerant, observable, and performant API infrastructure.
  • Instrument services with OpenTelemetry for unified metrics, tracing, and logging.
  • Implement data validation, schema evolution, and lineage tracking across AI pipelines.
  • Enforce data privacy, RBAC, and compliance for model inputs and stored context.
  • Collaborate with SRE and AI teams to monitor and optimize end‑to‑end AI system performance.
What You'll Need:
  • Bachelor’s degree in Computer Science, Data Engineering, or a related field.
  • 3+ years of experience in backend or data systems engineering.
  • Experience building streaming data pipelines (Kafka / Spark or any similar technology).
  • Strong programming background in Java and Python, including microservice design.
  • Experience with ETL, data modeling, and distributed storage systems.
  • Familiarity with LLM pipelines, embeddings, and vector retrieval.
  • Understanding of Kubernetes, containerization, and CI/CD workflows.
  • Awareness of data governance, validation, and lineage best practices.
  • Strong communication and collaboration across AI, Data, and Platform teams.

Residents of California, click Here to view our California Applicant Privacy Notice.

Anticipated Application Close Date: 01/07/25

LogicMonitor is an Equal Opportunity EmployerAt LogicMonitor, we believe that innovation thrives when every voice is heard and each individual is empowered to bring their unique perspective. We’re committed to creating a workplace where diversity is celebrated, and all employees feel inspired and supported to contribute their best.

For us, equal opportunity means fostering a truly inclusive culture where everyone has the chance to grow and succeed. We don’t just open doors; we invite you to step through and be part of something bigger. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

#LI-JP1 #LI-Hybrid #BI-Hybrid

LogicMonitor is dedicated to fostering a culture of transparency and fairness, including our commitment to pay transparency. We provide the base salary ranges for all positions posted within the United States. 

Compensation packages at LogicMonitor for eligible roles include base salary, a variable plan depending on role, along with comprehensive benefits. The range displayed on each job posting reflects the minimum and maximum base salary target for new hires in the position, determined by work location and additional factors, including job-related skills, experience, interview performance, and relevant education or training. LogicMonitor employees in eligible roles are also granted equity based compensation, subject to Board of Director approval. As part of our holistic compensation philosophy, your package will also include, but is not limited to: Comprehensive health, dental and vision coverage, generous parental leave policies, access to our Employee Assistance Program and various Wellness programs, a 401K with company matching, a learning and development stipend, and an unlimited vacation policy. For more information on our benefits, see our careers page.

The Base Salary range for this role is:$120,230—$165,330 USD

                                               

Our goal is to ensure an accessible and inclusive experience for every candidate.

If you need a reasonable accommodation during the application or interview process under applicable local law, please submit a request via this Accommodation Request Form.

Know your rights: workplace discrimination is illegal. Please click here to review LogicMonitor’s U.S. Pay Transparency Nondiscrimination Provision.