Quick overview
Job description
We are seeking a technical operations leader to join the AI Infra Operations team as a Principal Systems Engineer supporting GPU infrastructure in Oracle Cloud Infrastructure (OCI). In this role, you will lead the development and maintenance of automation and operational tooling for GPU fleets across multiple regions, ensuring high availability. You will collaborate closely with engineering and operations teams to build robust automation, observability, and reliability solutions while continuously improving GPU operations.
Responsibilities:
• Build and maintain automation and operational tooling for OCI GPU infrastructure across multiple geographic regions.
• Drive collaboration with software engineers, hardware teams, and operations partners to maintain a highly available GPU fleet.
• Build and improve monitoring, alerting, and diagnostics for GPU fleet health, performance, capacity, and utilization using tools such as Grafana.
• Serve as the senior escalation point for complex GPU host and repair issues
• Participate in incident response and root-cause analysis to remove blockers affecting GPU capacity, availability, and regional deployments.
• Continuously improve AI2 Ops processes, GPU fleet automation, and OCI region build readiness.
• Participate in on-call rotations and provide support for critical infrastructure issues.
• Document operational procedures, automation workflows, troubleshooting guides, and runbooks.
• Build and improve AI agents, ensuring safe rollout, execution and monitoring.
• Mentor and guide junior engineers in operational best practices, provide senior technical support, and drive constant improvement.
Required Qualifications:
• Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
• 7+ years of software operations or infrastructure automation experience with strong proficiency in Python and Bash.
• Expert Linux administration experience, particularly Ubuntu and Oracle Linux, in large-scale production environments.
• Strong understanding of distributed systems, including peer-to-peer, node-to-node, and service-to-service communication patterns.
• Strong data-center and host-lifecycle experience, including provisioning, validation, repair workflows, hardware replacement, and fleet recovery.
• Strong problem-solving and troubleshooting skills.
• Excellent communication and teamwork skills.
• Experience with observability tooling, including metrics, logging, dashboards, and alerting.
• Experience with AI agents and tooling
• Experience leading on-call operations and incident response.
Preferred Skills:
• Hands-on experience with GPU infrastructure, including NVIDIA and AMD based systems, and familiarity with GPU shapes or instance families.
• Experience operating or automating GPU, compute, or other large-scale cloud infrastructure.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- VU

System Engineer, GIOCRecently posted Auto Apply
Vultr · Chennai · On-site · Posted 19 Nov 2026 🇮🇳
BashConfluencePagerDuty+5TechnologySalary not listed - SG
Database Administrator MySQL | Bangalore | 5+ YearsRecently posted Auto Apply
Sperton Global AS · Navi Mumbai · Hybrid · Posted 18 Nov 2026 🇮🇳
Talent AcquisitionMySQLSQL+2TechnologySalary not listed - RJ
IT System Administrator IRecently posted Auto Apply
Rubrik Job Board · Bengaluru · Hybrid · Posted 18 Nov 2026 🇮🇳
OnboardingSwiftGoogle Workspace+10TechnologySalary not listed - EX

System Engineer- Chennai, IndiaRecently posted Auto Apply
Exasol · Chennai · Hybrid · Posted 17 Nov 2026 🇮🇳
WorkdayShellTCP/IP+3TechnologySalary not listed - WA

Senior Staff System engineerRecently posted Auto Apply
Wabtec · Bengaluru, KA · On-site · Posted 17 Nov 2026 🇮🇳
Stakeholder ManagementEmbedded SystemsDiversity & Inclusion+2TechnologySalary not listed - BE
Network EngineerRecently posted Auto Apply
BETSOL · Bengaluru, KA · On-site · Posted 17 Nov 2026 🇮🇳
AWSBashDNS+5TechnologySalary not listed - F7
Staff Systems Administrator (5996) Auto Apply
F7d8749a 72d6 407c Bf98 292ea630c73a · Bengaluru · Hybrid 🇮🇳
OnboardingGitAWS+19TechnologySalary not listed - F7
Senior Systems Administrator (6006) Auto Apply
F7d8749a 72d6 407c Bf98 292ea630c73a · Bengaluru · Hybrid 🇮🇳
Microsoft OfficeTCP/IPActive Directory+15TechnologySalary not listed - SS
Kafka & AWS AdminRecently posted Auto Apply
Sopra Steria · Noida, Uttar Pradesh · Hybrid · Posted 13 Nov 2026 🇮🇳
DynamoDBAWSApache+11TechnologySalary not listed - EU
Infrastructure Support Engineer Auto Apply
Eurofins · Bengaluru, KA · Hybrid · Posted 12 Nov 2026 🇮🇳
Active DirectoryApacheBash+5TechnologySalary not listed - KE

Senior Windows Infrastructure Design Engineer (L3/L3.5) Auto Apply
Keyloop · Hyderabad · Hybrid · Posted 11 Nov 2026 🇮🇳
Stakeholder ManagementActive DirectoryAnsible+11Salary not listed - PH

Senior System Engineer Auto Apply
PHONEPE LIMITED · Mumbai, Maharashtra · On-site · Posted 11 Nov 2026 🇮🇳
Google WorkspaceAndroidJira+3TechnologySalary not listed
