Quick overview
Job description
About Vmax
Vmax is an applied research lab developing AI capable of open-ended learning. We are building systems to exceed humans in all capacities by optimising beyond the local maxima of learning from human expertise.
About the role
This role is for exceptional ML engineers who can turn RL research ideas into working training systems, evals, environment and rewards. You will work across research and engineering to make post-training methods reliable, measurable, and fast to iterate on.
Responsibilities
- Build and improve RL training pipelines for language model based agents.
- Translate research ideas into working implementations, including reward functions, verifiers, environment interfaces, rollout pipelines, and evaluation harnesses.
- Design experiments that test whether RL methods are actually improving model behavior, sample efficiency, robustness, or generalization.
- Create quality monitoring tools for RL experiments, including regression tests, eval suites, and reward-hacking checks.
- Debug unstable training runs, diagnose poor learning dynamics, and identify whether failures come from algorithms, rewards, data, infrastructure, or evals.
- Build 0→1 systems for new RL workflows, then harden them into reusable infrastructure.
- Improve the reliability, reproducibility, and speed of experimentation across RL projects.
- Own technically ambiguous projects end to end, from problem framing through implementation, evaluation, and iteration.
Minimum Requirements
- Strong practical ML engineering ability, demonstrated through shipped systems, open-source projects, competitions, independent projects, or equivalent experience.
- Hands-on experience building, training, evaluating, or debugging ML systems.
- Strong programming ability in Python and experience with at least one major ML framework such as PyTorch or JAX.
- Working understanding of reinforcement learning, supervised learning, optimization, and modern deep learning.
- Ability to independently take an ambiguous technical problem and drive it to a working implementation..
- Ability to collaborate closely with researchers while maintaining high engineering standards.
- Experience building systems that are reliable, maintainable, and usable by other technical team members.
- Clear written and verbal communication.
Nice to have
- Experience supporting research teams or fast-moving ML teams.
- Expertise in building experiment tracking, evaluation platforms, dataset/versioning systems, or reproducibility infrastructure.
- Experience at a high engineering bar organization where reliability, ownership, and code quality were central.
- Experience reducing operational complexity in systems that had become brittle, slow, or hard to debug.
Role specific location policy
- This role is based in our San Francisco office; For exceptional candidates we are willing to consider a hybrid arrangement
Compensation
The expected salary range for this position is $300,000 - $500,000 USD
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- NR

Software Engineer II - Query GatewayRecently posted Auto Apply
New Relic · Portland · Hybrid · Posted 19 Nov 2026 🇺🇸
DockerGCPAWS+8Technology$126k - $158k/yr - SF

Senior Software Engineer - Middle and Back OfficeRecently posted Auto Apply
Soros Fund Management · New York · Hybrid · Posted 19 Nov 2026 🇺🇸
SQLAWSSnowflake+7Technology$190k - $250k/yr - EL

Senior Software Engineer - Platform Billing CoreRecently posted Auto Apply
Elastic · United States · Hybrid · Posted 19 Nov 2026 🇺🇸
GCPAWSPython+2Technology$133.1k - $210.6k/yr - TJ
Senior Software EngineerRecently posted Auto Apply
Third-Party Job Posts · United States · Hybrid · Posted 19 Nov 2026 🇺🇸
DockerPHPAWS+11Technology$140k/yr - AN

Staff+ Software Engineer, GRC PlatformRecently posted Auto Apply
Anthropic · San Francisco · Hybrid · Posted 19 Nov 2026 🇺🇸
GCPAWSETL+9Technology$320k/yr - AI

Staff Software Engineer, Payments (AirCover Insurance Platform)Recently posted Auto Apply
Airbnb · Remote - USA · Remote · Posted 19 Nov 2026 🇺🇸
SQLJavaKotlin+1Technology$212k - $265k/yr - AD

Software Engineer II (Kotlin) - Core ExperienceRecently posted Auto Apply
Adyen · Chicago · Hybrid · Posted 19 Nov 2026 🇺🇸
Android SDKC++Jetpack Compose+3Technology$154k - $200k/yr - AI

Infra Software Engineer, Agentic RuntimeRecently posted Auto Apply
Anduril Industries · Costa Mesa · Hybrid · Posted 19 Nov 2026 🇺🇸
DockerRustRobotics+8TechnologySalary not listed - LA

Principal Software EngineerRecently posted Auto Apply
Lambda · Bellevue Office · Hybrid · Posted 19 Nov 2026 🇺🇸
GCPAWSMachine Learning+1TechnologySalary not listed - DE

Senior Software Engineer, Oracle/NetSuiteRecently posted Auto Apply
Delinea · U.S. Remote · Remote · Posted 19 Nov 2026 🇺🇸
OraclePL/SQLSQL+4TechnologySalary not listed - CL

Senior Software Engineer - ClickHouse Private (Remote)Recently posted Auto Apply
Clickhouse · United States · Remote · Posted 17 Nov 2026 🇺🇸
GCPAWSHelm+4TechnologySalary not listed - FC
Software Engineer III (FanApp)Recently posted Auto Apply
Fanatics Commerce · Redwood City · Hybrid · Posted 19 Nov 2026 🇺🇸
JavaRESTJavaScript+1Technology$146k - $180k/yr
