Quick overview
Job description
Job Title: Staff Observability & SLO Lead
Location: Foster City, CA
Position Overview
The Staff Observability & SLO Lead will drive observability practices and service reliability across application, deployment, and infrastructure environments. The role focuses on implementing monitoring, alerting, and Service Level Objective (SLO) / Service Level Indicator (SLI) frameworks; instrumenting systems with OpenTelemetry; analyzing telemetry and distributed traces; and supporting deployment validation, incident response, and production reliability.
Key Responsibilities
· Implement and maintain monitoring, alerting, and observability solutions using Prometheus and Grafana.
· Define, implement, and support SLO/SLI frameworks to measure and improve service reliability.
· Instrument applications and services using OpenTelemetry.
· Use Honeycomb or other distributed tracing platforms to investigate service behavior and performance.
· Analyze application, deployment, and infrastructure telemetry to identify performance issues and reliability risks.
· Support canary deployment validation and provide telemetry-based input for deployment and rollback decisions.
· Troubleshoot Linux and production environment issues.
· Participate in incident management, conduct root cause analysis, and support corrective actions.
· Collaborate with engineering, operations, and reliability teams to improve observability and service health.
Required Technical Skills
· Hands-on experience with Prometheus and Grafana.
· Monitoring and alerting implementation.
· Service Level Objectives (SLOs) and Service Level Indicators (SLIs) frameworks.
· OpenTelemetry instrumentation.
· Honeycomb or other distributed tracing platforms.
· Analysis of application, deployment, and infrastructure telemetry.
· Canary deployment validation and rollback decision support.
· Linux administration and production troubleshooting.
· Incident management and root cause analysis.
Preferred Skills
· Kubernetes observability and service health monitoring.
· Reliability engineering best practices.
Experience and Work Arrangement
· 8–10 years of relevant professional experience.
· One onsite position based in Foster City, California.
Key Areas of Expertise
· Metrics, monitoring, and alerting with Prometheus and Grafana
· SLO/SLI design and service reliability measurement
· OpenTelemetry instrumentation and distributed tracing
· Telemetry analysis across applications, deployments, and infrastructure
· Canary deployment validation and rollback support
· Linux troubleshooting, incident management, and root cause analysis
· Kubernetes observability and reliability engineering
Similar jobs
- ST
Physical Design EngineerRecently posted
SR Talent Solution Inc · United States · Remote 🇺🇸
RISC-VVerilogEngineeringSalary not listed - WS
PCB Design & Layout EngineerRecently posted
Wise Skulls Corp. · Dallas, TX · On-site 🇺🇸
PCB DesignEngineeringSalary not listed - SO

VOIP Engineer Sr.Recently posted
System One · New York, NY · On-site 🇺🇸
Microsoft TeamsEngineering$47/hr - UM

Senior Development EngineerRecently posted Auto Apply
Ursa Major · Berthoud · Hybrid 🇺🇸
AssemblyCADFEA+1Engineering$115k - $145k/yr - TR

Managed Services Engineer (On-site)Recently posted Auto Apply
Trace3 · Dallas · Hybrid 🇺🇸
RecruitingMicrosoft OfficeTechnical Support+4Engineering$58k - $65k/yr - TE

DFT EngineerRecently posted Auto Apply
Tenstorrent · Austin · Hybrid 🇺🇸
ComplianceRISC-VVerilogEngineering$100k - $500k/yr - VS

Senior Mechanical Design Engineer, ControlsRecently posted Auto Apply
Varda Space Industries · El Segundo · Hybrid 🇺🇸
FiberAssemblyCAD+6Engineering$140.3k - $179.3k/yr - VS

Senior Automation & Controls EngineerRecently posted Auto Apply
Varda Space Industries · El Segundo · Hybrid 🇺🇸
FiberElectrical DesignGrafana+3Engineering$140.3k - $179.3k/yr - VT

Chief EngineerRecently posted Auto Apply
Voyager Technologies, Inc. · Folsom · Remote 🇺🇸
Stakeholder ManagementBudgetingEngineering$190k - $250k/yr - SH

Plumbing Engineer II - IV/Designer II - IV - HealthcareRecently posted Auto Apply
Syska Hennessy Group · Washington D.C. · Hybrid 🇺🇸
Building CodesDue DiligenceLEED+2Engineering$68.8k - $132.3k/yr - TO

FPGA EngineerRecently posted Auto Apply
Tomorrow.io · Golden · Hybrid 🇺🇸
FPGAConcreteAltium+6Engineering$140k - $160k/yr - SH

Mechanical Engineer III - IVRecently posted Auto Apply
Syska Hennessy Group · Los Angeles · Hybrid 🇺🇸
AutoCADCADDue Diligence+2Engineering$67.6k - $143.1k/yr