Why this role stands out
This role offers a unique opportunity to build foundational infrastructure for cutting-edge AI research at a renowned lab, providing immense growth and learning potential. You will thrive here if you are a seasoned infrastructure engineer passionate about scaling complex distributed systems and enabling groundbreaking advancements in machine learning. Apply now to shape the future of AI!
Quick overview
Job description
About Vmax
Vmax is an applied research lab developing AI capable of open-ended learning. We are building systems to exceed humans in all capacities by optimising beyond the local maxima of learning from human expertise.
About the role
This role is for strong infrastructure engineers who can build the systems layer for RL at scale: distributed rollouts, training orchestration, inference, evals, data pipelines, observability, and reliability. You will create the durable platform that enables researchers and applied ML engineers to run, debug, and reproduce large-scale RL experiments.
Responsibilities
- Build infrastructure for distributed RL training and inference across thousands of GPUs
- Improve the reliability, debuggability, and throughput of RL experiments.
- Build interfaces that allow researchers and applied ML engineers to launch, inspect, compare, and reproduce experiments easily.
- Own infrastructure projects end to end, from architecture and implementation through deployment, documentation, and long-term maintenance.
- Identify and eliminate bottlenecks in training, rollout generation, eval execution, data movement, and cluster utilization.
- Maintain engineering standards for RL infrastructure, including testing, observability, versioning, and reproducibility.
Minimum Requirements
- Strong software engineering experience.
- Experience building infrastructure for LLM inference and/or RL training.
- Experience with GPU clusters, distributed training, model serving, or high-throughput inference systems.
- Familiarity with vLLM, SGLang and modern LLM-RL training frameworks
- Strong understanding of system reliability, observability, testing, debugging, and performance optimization.
- Ability to work closely with ML researchers and translate messy experimental workflows into durable infrastructure.
- Experience building tools, platforms, or services used by other technical users.
- Strong judgment around technical tradeoffs: when to prototype, when to harden, when to simplify, and when to redesign.
- Clear written and verbal communication, especially around system design, operational risks, and engineering tradeoffs.
Nice to have
- Experience supporting research teams or fast-moving ML teams.
- Experience at a high engineering bar organization where reliability, ownership, and code quality were central.
- Evidence of strong independent technical work, such as open-source projects, infrastructure projects, competitions, or substantial systems built from scratch.
- Experience reducing operational complexity in systems that had become brittle, slow, or hard to debug.
Role specific location policy
- This role is based in our San Francisco office; for exceptional candidates we are willing to consider a hybrid arrangement
Compensation
The expected salary range for this position is $300,000 - $500,000 USD
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- NR

Software Engineer II - Query GatewayRecently posted Auto Apply
New Relic · Portland · Hybrid · Posted 19 Nov 2026 🇺🇸
DockerGCPAWS+8Technology$126k - $158k/yr - SF

Senior Software Engineer - Middle and Back OfficeRecently posted Auto Apply
Soros Fund Management · New York · Hybrid · Posted 19 Nov 2026 🇺🇸
SQLAWSSnowflake+7Technology$190k - $250k/yr - EL

Senior Software Engineer - Platform Billing CoreRecently posted Auto Apply
Elastic · United States · Hybrid · Posted 19 Nov 2026 🇺🇸
GCPAWSPython+2Technology$133.1k - $210.6k/yr - TJ
Senior Software EngineerRecently posted Auto Apply
Third-Party Job Posts · United States · Hybrid · Posted 19 Nov 2026 🇺🇸
DockerPHPAWS+11Technology$140k/yr - AN

Staff+ Software Engineer, GRC PlatformRecently posted Auto Apply
Anthropic · San Francisco · Hybrid · Posted 19 Nov 2026 🇺🇸
GCPAWSETL+9Technology$320k/yr - AI

Staff Software Engineer, Payments (AirCover Insurance Platform)Recently posted Auto Apply
Airbnb · Remote - USA · Remote · Posted 19 Nov 2026 🇺🇸
SQLJavaKotlin+1Technology$212k - $265k/yr - AD

Software Engineer II (Kotlin) - Core ExperienceRecently posted Auto Apply
Adyen · Chicago · Hybrid · Posted 19 Nov 2026 🇺🇸
Android SDKC++Jetpack Compose+3Technology$154k - $200k/yr - AI

Infra Software Engineer, Agentic RuntimeRecently posted Auto Apply
Anduril Industries · Costa Mesa · Hybrid · Posted 19 Nov 2026 🇺🇸
DockerRustRobotics+8TechnologySalary not listed - LA

Principal Software EngineerRecently posted Auto Apply
Lambda · Bellevue Office · Hybrid · Posted 19 Nov 2026 🇺🇸
GCPAWSMachine Learning+1TechnologySalary not listed - DE

Senior Software Engineer, Oracle/NetSuiteRecently posted Auto Apply
Delinea · U.S. Remote · Remote · Posted 19 Nov 2026 🇺🇸
OraclePL/SQLSQL+4TechnologySalary not listed - CL

Senior Software Engineer - ClickHouse Private (Remote)Recently posted Auto Apply
Clickhouse · United States · Remote · Posted 17 Nov 2026 🇺🇸
GCPAWSHelm+4TechnologySalary not listed - FC
Software Engineer III (FanApp)Recently posted Auto Apply
Fanatics Commerce · Redwood City · Hybrid · Posted 19 Nov 2026 🇺🇸
JavaRESTJavaScript+1Technology$146k - $180k/yr
