Why this role stands out
You can drive the future of AI inference by building scalable cloud orchestration systems for vLLM, a role offering significant impact and a competitive compensation package of $200,000-$400,000. This opportunity is ideal for experienced cloud engineers passionate about robust infrastructure and eager to contribute to a rapidly advancing field. Apply now to shape the operational backbone of cutting-edge AI technology.
Quick overview
Job description
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.
About the Role
We're looking for an cloud orchestration engineer to build the operational backbone that keeps vLLM running reliably at massive scale. You'll design the systems for cluster management, deployment automation, and production monitoring that enable teams worldwide to serve AI models without friction. You'll ensure that vLLM deployments are observable, debuggable, and recoverable, turning operational complexity into infrastructure that just works.
Skills and Qualifications
Minimum qualifications:
Bachelor's degree or equivalent experience in computer science, engineering, or similar.
Strong experience with Kubernetes and container orchestration at scale.
Experience designing and implementing custom Kubernetes operators.
Proficiency in Python/Rust/Go and infrastructure-as-code tools (Terraform, Helm, etc).
Experience managing GPU clusters and debugging hardware issues.
Ability to work across cloud platforms (AWS, GCP, Azure) and on-premise infrastructure.
Preferred qualifications:
Experience with ML-specific orchestration tools (Ray, Slurm).
Knowledge of GPU scheduling, multi-tenancy, and resource optimization.
Familiarity with vLLM deployment patterns and configuration.
Track record of improving operational reliability for ML systems.
Bonus points if you have:
Experience deploying inference systems on large-scale GPU (1,000+) clusters.
Logistics
Location: This role is based in San Francisco, California. Will consider remote in the US for exceptional candidates.
Compensation: Depending on background, skills, and experience, the expected annual salary range for this position is $200,000 - $400,000 USD + equity.
Visa sponsorship: We sponsor visas on a case-by-case basis.
Benefits: Inferact offers generous health, dental, and vision benefits as well as 401(k) company match.
Inferact, Inc. is an E-Verify company, and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- WE

Senior Infrastructure Engineer Auto Apply
Webflow · United States · Remote · Posted 2 Nov 2026 🇺🇸
MongoDBApache SparkAWS+14Technology$165k - $225k/yr - TT
Infrastructure EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 15 Nov 2026 🇺🇸
GCPAWSData Pipeline+6Technology$150k - $300k/yr - NI

Staff Cloud Security Engineer Auto Apply
Ninjatrader · Chicago · Hybrid · Posted 30 Oct 2026 🇺🇸
GCPAWSEncryption+13TechnologySalary not listed - LT
Senior Cloud Engineer Auto Apply
Liveview Technologies · Seattle · Hybrid 🇺🇸
GitAWSArgoCD+9TechnologySalary not listed - LA

Cloud Security EngineerRecently posted Auto Apply
Latacora · United States · Remote · Posted 13 Nov 2026 🇺🇸
GCPGoogle WorkspaceGit+7Technology$125k - $160k/yr - F7
Staff Cloud Engineer (R5801)Recently posted Auto Apply
F7d8749a 72d6 407c Bf98 292ea630c73a · San Diego · Hybrid · Posted 12 Nov 2026 🇺🇸
Talent AcquisitionAWSCapacity Planning+6TechnologySalary not listed - F7
Staff Cloud Engineer (R5801)Recently posted Auto Apply
F7d8749a 72d6 407c Bf98 292ea630c73a · San Mateo · Hybrid · Posted 12 Nov 2026 🇺🇸
Talent AcquisitionAWSCapacity Planning+6TechnologySalary not listed - F7
Staff Infrastructure Engineer (R6109) Auto Apply
F7d8749a 72d6 407c Bf98 292ea630c73a · San Mateo · Hybrid · Posted 22 Oct 2026 🇺🇸
Talent AcquisitionAWSTCP/IP+17TechnologySalary not listed - F7
Senior Site Infrastructure Engineer (R5857) Auto Apply
F7d8749a 72d6 407c Bf98 292ea630c73a · Seattle · On-site 🇺🇸
Talent AcquisitionFiberAWS+7TechnologySalary not listed - F7
Senior Network Engineer (R5667) Auto Apply
F7d8749a 72d6 407c Bf98 292ea630c73a · San Mateo · Hybrid 🇺🇸
Talent AcquisitionAWSAnsible+14TechnologySalary not listed - F7
Senior Engineer, Platform Infrastructure (R5516) Auto Apply
F7d8749a 72d6 407c Bf98 292ea630c73a · Dallas · Hybrid 🇺🇸
Talent AcquisitionPackerGit+11Salary not listed - SC
NVIDIA Infrastructure Engineer — NVIDIA V100 or A100Recently posted Auto Apply
Syncreon Consulting · New York, NY · On-site · Posted 13 Nov 2026 🇺🇸
KubernetesTechnologySalary not listed
