Quick overview
Job description
In This Role, You Will
- Lead complex infrastructure initiatives supporting Generative AI and Predictive AI platforms from design to production operations.
- Serve as a technical lead for platforms supporting AI/ML model training, inference, and batch workloads.
- Design, build, deploy, and operate OpenShift-based container platforms optimized for high-performance GPU workloads.
- Build, support and operate scalable GPU SuperPod architecture with large multi-node GPU clusters.
- Own monitoring, alerting, and observability using Grafana, Splunk, and enterprise telemetry tools.
- Define SLIs/SLOs and build actionable alerts to proactively detect performance, capacity, and resiliency risks.
- Build AI- and agent-based automation tools for self-healing, scaling, diagnostics, and incident remediation.
- Apply AIOps techniques to reduce alert fatigue and improve platform reliability.
- Lead production incident analysis and ensure operational rigor and root-cause prevention.
- Mentor engineers and influence stakeholders across a geographically distributed organization.
Required Qualifications
- 5+ years of infrastructure engineering experience.
- 5+ years troubleshooting complex end-to-end architectures(including CI/CD pipeline).
- 5+ years Linux systems experience.
- 4+ years supporting AI/ML platforms.
- 4+ years of Kubernetes / container platform experience including production support.
Desired Qualifications
- Experience with Generative AI and Predictive AI platforms.
- Hands-on GPU platform operations including scheduling, quota, and performance tuning.
- Experience with OpenShift in GPU-enabled, multi-tenant environments.
- Experience designing or operating GPU Super Pods.
- Deep experience with observability using Grafana, Splunk, and custom telemetry pipelines.
- Experience building AI- or agent-driven automation tooling (AIOps).
- Hands-on experience supporting AI/ML workloads on Google Cloud Platform and Azure, including GPU-backed services and managed AI infrastructure
- Experience operating hybrid or multi-cloud AI platforms, with an understanding of cloud-native services, networking, identity, and cost optimization for Generative and Predictive AI
- Strong monitoring of AI signals such as inference latency and GPU utilization.
- Experience with BCP/DR, resiliency, and highly available architectures.
Job Expectations
- Participation in a 24x7 on-call rotation.
- Ownership for production stability, platform health, and customer outcomes.
- Operate in regulated enterprise environments with strong risk and control focus
Similar jobs
- FO

AI Engineer IRecently posted
FedEx Office · Memphis, TN · Hybrid 🇺🇸
DockerSQLGit+28Technology$8.9k - $12.0k/mo - SP
Lead Engineer, AI Infrastructure (C++, C)Recently posted Auto Apply
SpaceXSI · Palo Alto · Hybrid 🇺🇸
C++$220k - $357k/yr - ES

Python AI EngineerRecently posted
EPAM Systems · New York, NY · Hybrid 🇺🇸
DockerFastAPINeo4j+15TechnologySalary not listed - ES

Python AI EngineerRecently posted
EPAM Systems · United States · Hybrid 🇺🇸
DockerFastAPINeo4j+15TechnologySalary not listed - TT
Founding AI Agent EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco Bay Area · On-site 🇺🇸
RecruitingCRMClinical Trials+2$150k - $220k/yr - JO

Lead ML/AI EngineerRecently posted Auto Apply
Jobgether · United States · Remote 🇺🇸
SQLApache SparkAWS+25TechnologySalary not listed - JO

Lead AI EngineerRecently posted Auto Apply
Jobgether · United States · Remote 🇺🇸
DockerSQLGit+24TechnologySalary not listed - JO

Staff AI EngineerRecently posted Auto Apply
Jobgether · United States · Remote 🇺🇸
DjangoContinuous ImprovementData Privacy+8TechnologySalary not listed - JO

Senior Knowledge EngineerRecently posted Auto Apply
Jobgether · United States · Remote 🇺🇸
SQLContinuous ImprovementData Privacy+1EngineeringSalary not listed - JO

Senior AI Engineer (AI Automation)Recently posted Auto Apply
Jobgether · United States · Remote 🇺🇸
ConcreteContinuous ImprovementData Privacy+7TechnologySalary not listed - JO

Staff Engineer / AI BuilderRecently posted Auto Apply
Jobgether · United States · Remote 🇺🇸
DockerDynamoDBAWS+12Technology$165.6k - $228.5k/yr - JO

Sr AI Architect, Application SecurityRecently posted Auto Apply
Jobgether · United States · Remote 🇺🇸
AWSMLOpsOWASP+8TechnologySalary not listed
