Incident Support Engineer (Automotive Domain)

Job Description: Incident Management (IM) Support Engineer

24/7 Operations Connected Car & Telematics

Role Summary

We are seeking Support Engineer role for a 24/7 Incident Management (IM) operations program supporting a key player in the automotive industry's connected car space. This role will primarily focus on monitoring the system health using different data monitoring tools such as Datadog, Grafana, MaxGauge, Elastic, Dynatrace. Once an anomaly or unusual pattern is observed, escalate it to the respective teams, initiate an incident bridge, driving the bridge, taking incident timeline, facilitate the teams to bring an ongoing incident to closure and ensuring adherence to contractual SLAs. The IM Support Engineer will orchestrate end-to-end incident handling-from anomaly detection to bridge initiation, stakeholder communications, resolution, and post-incident governance-with a strong background in Telematics and Connected Vehicle systems (including Remote Services).

Key Responsibilities

Monitor the health and availability of production systems supporting the Connected Car / Telematics ecosystem.

Proactively monitor application, infrastructure, API, database, and service health using tools such as:

Datadog

Grafana

MaxGauge

Application and system logs

Organization-specific monitoring and observability tools

Identify abnormal system behavior, performance degradation, errors, latency, service failures, and potential outages.

Analyze dashboards, alerts, metrics, logs, and application behavior to identify the initial scope and impact of incidents.

Perform proactive monitoring to identify issues before they impact customers.

Validate alerts and distinguish between genuine production incidents and false positives/noise.

Adhere to the IM SLAs (MTTD, MTTA, MTTR, communication SLAs); ensure measurement, reporting, and continuous improvement.

Should be proficient in handling the incidents ranging from high priority ones (P1, P2) to the low priority incidents (P3, P4).

Initiate and run incident bridges/war rooms; coordinate cross-functional responders (application, infrastructure, network, OEM partners, and third parties).

Oversee proactive detection through data monitoring tools (Datadog, Dynatrace, Grafana, MaxGauge) and ensure alert quality, runbooks, and signal-to-noise optimization.

Establish and enforce SOPs for incident declaration, severity classification, response roles and decision logs.

Drive disciplined stakeholder communications: timely updates to product, operations, OEM/customer contacts, leadership, and impacted regions; maintain comms cadence and channels.

Ensure post-incident governance: facilitate RCA, document contributing causes, corrective and preventive actions (CAPA), and circulate the RCA across teams for sign-off.

Define and maintain IM dashboards, KPIs, and executive reports; present weekly/monthly service reviews with trend analysis and action plans.

Collaborate with Product/Engineering to influence reliability roadmaps (resiliency patterns, observability, capacity, release safeguards).

Ensure compliance with information security, data privacy, and OEM contractual obligations during incident handling and communications.

Continuously refine IM playbooks, runbooks, and training; conduct simulations/game days and readiness audits across onsite offshore teams.

Domain Expertise: Telematics & Connected Car

Hands-on knowledge of Telematics Control Unit (TCU), eSIM/OTA provisioning, backend telematics platforms, and data flows between vehicle, cloud, and mobile apps.

Understanding on Internet of Things including but not limited to Messaging Queues, bulk provisioning, notification systems, API Gateways, Load Balancers, Mobile applications & web applications.

Familiarity with Remote Services (e.g., remote lock/unlock, start/stop, charge control, climate pre-conditioning), geo-services, and safety/assist features.

Understanding of service dependencies: identity/auth, messaging, device management, CAN bus signals, firmware/OTA update orchestration, and regional compliance.

Experience coordinating incidents across OEM partners, Tier-1 suppliers, cloud providers, and customer support operations.

Required Qualifications

5+ years in Operations/Service Management with 4+ years leading Incident Management in large-scale, 24/7 environments.

Demonstrated experience running bridges for P1/P0 incidents; proven incident commander skills and decision-making under pressure.

Strong background in Telematics/Connected Car domain and vehicle remote services concepts.

Proficiency with observability and monitoring tools: Dynatrace, Datadog, Grafana, MaxGauge (dashboards, alerting, traces, logs).

Expertise in IM processes: detection triage severity assignment bridge initiation stakeholder updates resolution post-incident RCA.

Working knowledge of ITIL practices (Incident, Problem, Change, Service Level Management).

Should have good hands on experience in using tools like JIRA, Confluence, Jenkins, XMatters.

Excellent communication (written/verbal), executive presence, and stakeholder management across onsite offshore teams.

Ability to analyze telemetry and time-series data to drive root cause hypotheses and corrective actions.

Experience defining SLAs/SLOs and building KPI dashboards (MTTD/MTTA/MTTR, incident volume, recurrence, comms SLA, customer impact).

Tools & Technologies

Datadog, Dynatrace , Grafana, MaxGauge (APM, logs, metrics, dashboards).

Incident & Comms: ticketing (Jira/ServiceNow), chat/bridge tools (Teams/Zoom), status pages.

Data: time-series analysis, log aggregation, tracing, alerting policies and noise reduction.

Education & Experience

Bachelor's degree in engineering, Computer Science, or related field (or equivalent practical experience).

Location & Travel

Location: Costa Mesa, Orange County, California.

Work Model: Onsite presence from office is required 5 days a week.