Why this role stands out
This role offers a unique opportunity to directly impact the advancement of AI by ensuring the reliability and performance of cutting-edge GPU compute infrastructure. You'll thrive here if you have a passion for systems administration and are eager to own critical infrastructure in a fast-paced, innovative environment. Apply now to join a team at the forefront of AI inference technology.
Quick overview
Job description
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.
About the Role
We're looking for a hands-on supercomputing infrastructure engineer to own and operate the high-performance compute infrastructure that keeps Inferact engineering productive. Inferact runs on expensive, high-performance GPU and HPC clusters across neo-cloud and dedicated compute providers, on heterogeneous hardware that spans NVIDIA GPUs, AMD GPUs, and Google TPUs. Your job is to make sure that infrastructure is healthy, available, observable, and usable around the clock.
You'll take ownership of cluster health, accelerator availability, monitoring, alerting, scheduling, access, diagnostics, and incident response across the systems our engineers rely on every day, from NVIDIA and AMD GPU clusters to TPU environments. You'll work closely with engineering leadership and infrastructure owners to standardize how we provision, operate, debug, and scale compute across providers and hardware platforms. Your work will directly impact how fast Inferact can build, test, and improve the systems powering vLLM.
Skills and Qualifications
Minimum qualifications:
Bachelor's degree or equivalent experience in computer science, engineering, systems administration, or similar.
Hands-on experience administering large compute clusters, HPC environments, university or research clusters, supercomputing systems, or production GPU clusters.
Strong Linux systems administration fundamentals across networking, processes, storage, package management, shell scripting, logs, access control, and system debugging.
Experience operating GPU servers, including driver management, GPU health monitoring, node failures, memory errors, scheduler issues, and hardware diagnostics.
Experience with cluster scheduling and resource allocation using SLURM, Kubernetes, or equivalent tooling.
Ability to own urgent infrastructure incidents end-to-end when compute issues are blocking engineering teams.
Ability to automate operational workflows using Bash, Python, Ansible, Terraform, Helm, or similar tooling.
Preferred qualifications:
Experience managing 1,000+ GPGPUs in production.
Experience operating GPU compute across providers such as Lambda, CoreWeave, Crusoe, Nebius, Together, Fireworks, RunPod, or similar environments.
Experience improving cluster utilization, reducing idle or unavailable GPU capacity, and debugging scheduling or resource contention issues.
Familiarity with high-performance GPU networking such as InfiniBand, RoCE, NVLink / NVSwitch, RDMA, NCCL, or equivalent systems.
Experience with storage for HPC or ML workloads, including NFS, Lustre, Ceph, distributed filesystems, or other high-throughput storage systems.
Experience managing secure access, identity, permissions, SSH, VPNs, bastion hosts, secrets, and basic infrastructure security hygiene.
Background in research computing, scientific computing, ML infrastructure, SRE, platform engineering, or infrastructure operations for engineering-heavy teams.
Bonus points if you have:
Managed GPU or HPC infrastructure in a university lab, national lab, research institution, AI infrastructure company, hedge fund, HFT firm, or large-scale ML platform team.
Built monitoring, alerting, runbooks, health checks, or remediation workflows that materially reduced operational toil or incident resolution time.
Operated Kubernetes clusters for ML or GPU workloads at meaningful scale.
Standardized provisioning, diagnostics, monitoring, and operating patterns across multiple compute providers.
Carried real operational responsibility for infrastructure used by many engineers or researchers.
Logistics
Location: This role is based in San Francisco, California. Will consider remote in the US for exceptional candidates.
Compensation: Depending on background, skills, and experience, the expected annual salary range for this position is $200,000 - $400,000 USD + equity.
Visa sponsorship: We sponsor visas on a case-by-case basis.
Benefits: Inferact offers generous health, dental, and vision benefits as well as 401(k) company match.
Inferact, Inc. is an E-Verify company, and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- ST

Cleared Systems AdministratorRecently posted Auto Apply
STR · Woburn · Hybrid · Posted 13 Nov 2026 🇺🇸
Active DirectoryComplianceLDAP+3Technology$105k - $130k/yr - TE

Database AdministratorRecently posted Auto Apply
The Emily Program · 2355 Highway 36 W · Hybrid · Posted 13 Nov 2026 🇺🇸
SQLETLEncryption+10Technology$150.4k - $185.0k/yr - LT
Systems Engineer III Auto Apply
Liveview Technologies · American Fork · On-site · Posted 6 Nov 2026 🇺🇸
GCPMicrosoft OfficeGoogle Workspace+14TechnologySalary not listed - F7
PLM Systems Administrator (R6261)Recently posted Auto Apply
F7d8749a 72d6 407c Bf98 292ea630c73a · Dallas · Hybrid · Posted 9 Nov 2026 🇺🇸
PowerShellPythonVMware+2TechnologySalary not listed - F7
Associate Systems Administrator (R5874) Auto Apply
F7d8749a 72d6 407c Bf98 292ea630c73a · Wichita · Hybrid 🇺🇸
Talent AcquisitionMicrosoft OfficeTCP/IP+13TechnologySalary not listed - F7
Associate Systems Administrator (R5698) Auto Apply
F7d8749a 72d6 407c Bf98 292ea630c73a · Wichita · Hybrid 🇺🇸
Talent AcquisitionMicrosoft OfficeTCP/IP+13TechnologySalary not listed - RM
SharePoint AdministratorRecently posted Auto Apply
Resource Management Concepts, Inc. · West Bethesda, Maryland · On-site · Posted 13 Nov 2026 🇺🇸
SQLMicrosoft OfficeHTML+12Technology$145k - $165k/yr - PH

IT Operations EngineerRecently posted Auto Apply
Physicalintelligence · San Francisco · On-site · Posted 14 Nov 2026 🇺🇸
OnboardingGoogle WorkspaceRobotics+8TechnologySalary not listed - CO
CERTIFIED IT ADMINISTRATOR LAN/WAN, IVRecently posted Auto Apply
City of New York · New York City, NY · On-site · Posted 14 Nov 2026 🇺🇸
Active DirectoryAnsibleDNS+7TechnologySalary not listed - PC
Database Administrator Auto Apply
ProSidian Consulting, LLC · Rockville, MD · On-site 🇺🇸
Microsoft ExcelMicrosoft OfficeMicrosoft Word+2TechnologySalary not listed - EN

Mainframe Systems Programmer - CICSRecently posted Auto Apply
Ensono · Remote - United States · Remote · Posted 13 Nov 2026 🇺🇸
Technology$65k - $123k/yr - QU

Senior Systems AdministratorRecently posted Auto Apply
Qumulo · Seattle (hybrid) · Hybrid · Posted 13 Nov 2026 🇺🇸
GCPAWSSplunk+6Technology$140k - $170k/yr
