Why this role stands out
This fellowship offers an exceptional opportunity to pioneer cutting-edge research in open-ended AI learning, contributing directly to Vmax's reputation as a leader in AI development. You'll thrive if you're an early-career researcher eager to design novel RL methods and explore complex learning paradigms, with the chance to publish your groundbreaking work. Apply now to shape the future of AI!
Quick overview
Job description
About Vmax
Vmax is an applied research lab developing AI capable of open-ended learning. We are building systems to exceed humans in all capacities by optimising beyond the local maxima of learning from human expertise.
About the role
A core focus of ours is agents that can learn to find their own objectives in the world. We are looking for researchers to design and build new ways of using RL where the formulation of rewards and tasks need to be discovered, rather than given.
This 3 to 6 month fellowship is for PhD students or equivalent early-career researchers who want to work on LLMs that can learn in open-ended settings. You will own a focused research project, work closely with Vmax technical staff, and contribute to research publications.
Responsibilities
- Develop RL methods for agents that can discover useful objectives, tasks and curricula without relying entirely on human-specified rewards.
- Design systems for open-ended learning, including unsupervised/automated environment design, asymmetric self-play, and intrinsic motivation.
- Build training loops where agents learn from interaction, exploration, novelty, competence progress, self-generated challenges, or other nonstandard reward signals.
- Investigate how agents can avoid collapse into trivial, degenerate, or easily exploitable objectives.
- Own and develop a research agenda within Vmax, from identifying promising directions to executing experiments and communicating results.
Role Requirements
- Currently enrolled in a PhD program in machine learning, computer science, artificial intelligence, computational neuroscience, mathematics, or a related technical field. Exceptional candidates with equivalent research experience may also be considered.
- Track record of research excellence or strong research promise, demonstrated through publications, preprints, open-source work, technical projects, competitions, or publicly available artifacts.
- Working understanding of reinforcement learning.
- Familiarity with unsupervised/automated environment design, asymmetric self-play, and/or intrinsic motivation.
- Strong programming ability in Python and experience with at least one major ML framework such as PyTorch or JAX.
- Clear written and verbal communication of technical ideas.
Nice to have
- Experience with LLM post-training methods
- Experience with scalable ML experimentation, distributed training, experiment tracking, or reproducible research infrastructure.
- Demonstrated taste for identifying non-obvious research directions and converting them into tractable experiments.
Role specific location policy
- This role is based in our San Francisco office; for exceptional candidates we are willing to consider a hybrid arrangement
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- WA
PhD Drug Discovery Scientist (Pharma / Biotech), AI ExpertRecently posted Auto Apply
Weekday AI · United States · Remote · Posted 19 Nov 2026 🇺🇸
ArticulateGenerative AIHealthcare$70 - $100/hr - HR
Lead Quant Researcher, Event Driven SignalsRecently posted Auto Apply
hermeneutic research · United States · Remote · Posted 19 Nov 2026 🇺🇸
SQLBootstrapDerivatives+4Salary not listed - ON

Applied Scientist, Foundation ModelsRecently posted Auto Apply
Oneapp · United States (Remote) · Remote · Posted 19 Nov 2026 🇺🇸
Talent AcquisitionSalary not listed - AP

Associate Scientist III, BioassaysRecently posted Auto Apply
Arrowhead Pharmaceuticals · Madison · Hybrid · Posted 19 Nov 2026 🇺🇸
$80k - $90k/yr - AP

Scientist I, Quality Control (Validation)Recently posted Auto Apply
Arrowhead Pharmaceuticals · Verona · Hybrid · Posted 19 Nov 2026 🇺🇸
$90k - $105k/yr - AP

Associate Scientist I, Mechanistic PharmacologyRecently posted Auto Apply
Arrowhead Pharmaceuticals · Madison · Hybrid · Posted 18 Nov 2026 🇺🇸
Healthcare$55k - $68k/yr - TT
Physics Expert, Quantum Optics and Atomic PhysicsRecently posted Auto Apply
True Talent Solutions Partners · Remote · Remote · Posted 19 Nov 2026 🇺🇸
Auditing$100 - $170/hr - LA

Principal Scientist - Analytical Development & Quality ControlRecently posted Auto Apply
Landmarkbio · Watertown · On-site · Posted 18 Nov 2026 🇺🇸
ComplianceContinuous Improvement$150k - $180k/yr - MA

Senior / Principal BioProcess ScientistRecently posted Auto Apply
Maverickx · Austin · On-site · Posted 18 Nov 2026 🇺🇸
Root Cause AnalysisSalary not listed - MG
Junior Quant - MBSRecently posted Auto Apply
Man Group · Boston, New York · On-site · Posted 18 Nov 2026 🇺🇸
Onboarding$110k - $130k/yr - SA

Research Scientist - Frontier BenchmarksRecently posted Auto Apply
Snorkel AI · New York City · Remote · Posted 18 Nov 2026 🇺🇸
NLPArticulateLLM+1$200k - $350k/yr - IN
Senior Epidemiologist, Real-World EvidenceRecently posted Auto Apply
Intuitive · Sunnyvale, CA · On-site · Posted 18 Nov 2026 🇺🇸
Data AnalysisLogisticsSalary not listed
