Quick overview
Job description
Join a high-growth infrastructure team operating Kubernetes platforms across multiple cloud providers at massive scale. You'll build the systems that power thousands of GPUs, where your code and configurations directly protect thousands of GPU-hours from costly failures. EPAM is where tech talent thrives-building groundbreaking solutions, advancing your skills through world-class learning platforms, and working alongside a global community of problem-solvers to make the future real.
Req# Responsibilities Operate and scale Kubernetes platforms (EKS, GKE, and other distributions) including cluster lifecycle management, node pool optimization, and networking policies during periods of rapid growth Provision and manage HPC infrastructure through CI/CD pipelines spanning AWS, CoreWeave, Google Cloud Platform, OCI, and additional cloud providers Design and maintain job scheduling systems that efficiently allocate GPU compute resources across training and inference workloads Define SLIs/SLOs, build robust monitoring and alerting systems, and actively participate in incident response and post-incident reviews Develop production-quality tooling and automation to support multi-cloud infrastructure operations at scale Collaborate daily with Networking, Storage, Security, and AI/ML platform teams to ensure seamless cross-functional infrastructure delivery Requirements 10+ years of experience in infrastructure engineering, cloud platforms, or high-performance computing environments Expert-level Kubernetes experience at meaningful scale, including node pool sizing, scheduler debugging, CNI troubleshooting, and rolling upgrades across large fleets Advanced Python skills with a track record of building production-grade tools, not just scripts; experience with Go, Rust, or C++ is a strong plus Daily proficiency in Terraform for writing and reviewing infrastructure as code Working knowledge of core AWS services including EC2, S3, EFS, and FSx for Lustre Strong site reliability engineering background with experience building monitoring, alerting, and incident response practices CKA, CKS certificates are highly preferred
Similar jobs
- MR

DevOps Engineer I, onsite in West RaleighRecently posted
Motion Recruitment Partners, LLC · Raleigh, NC · Hybrid · Posted 11 Nov 2026 🇺🇸
DockerGitAWS+9TechnologySalary not listed - SB

DevOps Engineer Princeton - NJ - New JerseyRecently posted
Sierra Business Solution LLC · Princeton, NJ · Hybrid · Posted 10 Nov 2026 🇺🇸
SQLGitC+++2TechnologySalary not listed - IC

Sr devops engg with C#/.netRecently posted
Infinite Computer Solutions (ICS) · United States · Hybrid · Posted 10 Nov 2026 🇺🇸
GitC#PowerShell+2TechnologySalary not listed - VI

DevOps Engineer 10+ Yrs (W2/FTE Only)Recently posted
Virtusa Corporation · Westlake, TX · On-site · Posted 11 Nov 2026 🇺🇸
AWSService MeshDatadog+8TechnologySalary not listed - ST
Platform/DevOps EngineerRecently posted
SSV Technologies Inc · Dearborn, MI · Hybrid · Posted 10 Nov 2026 🇺🇸
DockerAnsibleBash+9TechnologySalary not listed - UL

DevOps Engineer - AI PlatformRecently posted
Ultimus LeverPoint · United States · Hybrid · Posted 11 Nov 2026 🇺🇸
SnowflakeBash.NET+9TechnologySalary not listed - SS

Software Engineer II - DevOps/DevSecOps with Security ClearanceRecently posted
Sierra Space · Centennial, CO · Hybrid · Posted 5 Nov 2026 🇺🇸
DockerGCPGit+16Technology$105.5k - $145.1k/yr - NI

SRE / Application Resiliency EngineerRecently posted
Nityo Infotech Corporation · Phoenix, AZ · Hybrid · Posted 11 Nov 2026 🇺🇸
ShellDNSPhoenix+2TechnologySalary not listed - II
Senior AI Engineer / AI Platform Engineer-OnsiteRecently posted
Innovative Information Technologies, Inc · Houston, TX · On-site · Posted 11 Nov 2026 🇺🇸
LLMPythonGenerative AI+1TechnologySalary not listed - PI

NETWORK ENGINEER V (Cloud DevOps Engineer )Recently posted
Protos IT · Washington, DC · On-site · Posted 11 Nov 2026 🇺🇸
ShellGitAWS+14TechnologySalary not listed - DI

AWS DevOps ArchitectRecently posted
Digicomplish Inc · Alameda, CA · Hybrid · Posted 11 Nov 2026 🇺🇸
Stakeholder ManagementGitAWS+12TechnologySalary not listed - TE
DevOps Engineer - Dallas, TX, Austin, TX, Houston, TX, San Antonio, TX.Recently posted
TechniPros, LLC · Dallas, TX · Hybrid · Posted 11 Nov 2026 🇺🇸
DockerGitAWS+8TechnologySalary not listed
