Lead Observability & APM Engineer

Need an in-person interview

Mandatory Requirements

1. More than seven (7) years of experience, with at least two (2) years in a leadership role.
2. Four (4) years of experience designing, configuring, and maintaining enterprise observability and log management platforms (e.g., Dynatrace, Datadog, CloudWatch, or ELK Stack).
3. Three (3) years of experience configuring application instrumentation, custom dashboards, and proactive alerting rules.

Desirable Qualifications

1. 5 years of experience writing complex search queries, regular expressions, and alert scripts (e.g., Splunk SPL, KQL).
2. 5 years of experience monitoring cloud-native infrastructure (AWS/Azure) and containerized applications (Kubernetes).
3. 5 years of experience integrating APM alerts with incident management systems (e.g., ServiceNow, Jira Service Management).

Position Overview & Key Responsibilities

The Lead Observability & APM Engineer (Specialist III) is responsible for designing and maintaining enterprise-wide observability, monitoring, and logging platforms. (Specialist III) is a senior technical leadership role responsible for architecting, implementing, and governing enterprise-wide observability, monitoring, and centralized logging platforms. Operating at the intersection of platform engineering, system reliability, and application performance, this role establishes the telemetry frameworks (metrics, logs, and traces) necessary to guarantee the uptime, scalability, and security of mission-critical systems. You will lead the design of proactive monitoring strategies, configure advanced application instrumentation across cloud-native and containerized environments, and partner with development and operations teams to drive rapid incident resolution and continuous performance optimization.

• Enterprise Observability Architecture: Architect, deploy, and govern centralized logging and Application Performance Monitoring (APM) solutions (e.g., Dynatrace, Datadog, Splunk, ELK Stack) across hybrid and cloud-native (AWS/Azure) environments.
• Application Instrumentation & Telemetry: Configure deep application-level instrumentation, runtime profiling, and distributed tracing. Design high-impact custom dashboards and establish intelligent, proactive alerting rules to detect anomalies before they impact end-users.
• Query Engineering & Analytics: Write and optimize complex search queries, regular expressions, and alert scripts (e.g., Splunk SPL, KQL) to extract actionable insights from high-volume machine data and log streams.
• Performance Engineering & Troubleshooting: Analyze complex system bottlenecks, memory leaks, thread dumps, and application errors. Partner with development and DevOps teams to diagnose root causes, perform post-mortem analyses, and optimize application performance.
• Cloud & Container Monitoring: Design and implement monitoring frameworks specifically tailored for containerized workloads (Kubernetes/EKS) and cloud-native infrastructure, ensuring full-stack visibility.
• ITSM & Incident Integration: Integrate APM and logging alerts with enterprise IT Service Management (ITSM) platforms (e.g., ServiceNow, Jira Service Management) to automate incident creation, routing, and escalation workflows.
• Data Governance & Compliance: Define and enforce enterprise log retention, archiving, and compliance policies. Ensure sensitive data (such as PII) is systematically masked or redacted within log pipelines while optimizing data ingestion and storage costs.
• Technical Leadership & Enablement: Provide technical direction and architectural governance for observability practices. Author comprehensive monitoring standards, and conduct training sessions to empower engineering teams to utilize observability tools effectively.