Quick overview
Job description
ABOUT THE COMPANY
We're building autonomous research agents for recursive self-improvement (multi-agent systems that propose, run, and analyze machine learning experiments). We're a small, well-funded team that works onsite in San Francisco.
ABOUT THE ROLE
You'll lead our work on model post-training: supervised fine-tuning, preference data, reinforcement learning from human and AI feedback, reward modeling, and the evaluation suites that tell us what's actually working. You'll own a research area that meaningfully shapes our model behavior and capability.
This is a hands-on senior research role. You'll set direction, run experiments, and ship into production. You'll partner with the data, infrastructure, and engineering teams to make the post-training pipeline reliable and fast: improvements there compound into every model we ship.
WHAT YOU'LL DO
Lead post-training research: SFT, RLHF/RLAIF, RLVR, DPO and successor methods, reward modeling, preference data design
Design and curate the data that goes into post-training (from sourcing, to filtering, to quality assessment)
Build and maintain the evaluation suites that measure what matters; resist Goodharting your own benchmarks
Run rigorous experiments (controls, ablations, statistical significance) and write up internal findings clearly
Scale data pipelines and the infrastructure team to scale training
Identify and characterize failure modes (reward hacking, distribution drift, eval saturation) and design experiments to address them
Stay current on the post-training literature; bring useful methods in, ignore the noise
WHAT WE'RE LOOKING FOR
Strong track record of post-training research (SFT, RL, reward modeling) at a frontier-model lab or equivalent
5+ years of hands-on ML research experience
Comfort with large-scale data curation and preference-data pipelines
Experience designing evaluation suites for capabilities that aren't easily benchmarked
Fluent in PyTorch or equivalent; comfortable at the scale of distributed training
Strong statistical instincts: you'd notice a flawed comparison before someone else points it out
Strong written communication
NICE TO HAVE
PhD in ML, statistics, CS, or adjacent
Published research at NeurIPS, ICML, ICLR, COLM, RLC, or comparable venues
Experience with reward hacking detection, scaling reward models, or RLHF infrastructure
Synthetic data generation experience
Background in RL math (policy gradients, importance sampling, off-policy methods)
Open-source contributions to post-training infrastructure
THIS ROLE IS PROBABLY NOT FOR YOU IF
You're primarily interested in pretraining (that's a different role)- You'd rather invent novel methods in isolation than ship them into a model that real users run
You prefer benchmarks that are stable to evaluation work where the right answer isn't yet defined
SPONSORSHIP SUPPORT
We sponsor visas to help exceptional talent join our team and support long-term immigration pathways where applicable.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- AP

Astrodynamics Lead (Founding Role)Recently posted Auto Apply
Apolink · Palo Alto · On-site · Posted 20 Nov 2026 🇺🇸
SSOAngularPython$150k - $190k/yr - GM

Scientist – Immunology and InflammationRecently posted Auto Apply
Genesis Molecular Ai · San Diego · On-site · Posted 20 Nov 2026 🇺🇸
Deep LearningHealthcareSalary not listed - UN
AI TheoryRecently posted Auto Apply
Unconventional, Inc. · Mountain View · Remote · Posted 20 Nov 2026 🇺🇸
NumPySciPyPyTorch+3Salary not listed - DA

PhD GenAI Research Scientist InternRecently posted Auto Apply
Databricks · San Francisco · Hybrid · Posted 20 Nov 2026 🇺🇸
Microsoft ExcelDatabricksDeep Learning+2Technology$54 - $60/hr - WA
PhD Drug Discovery Scientist (Pharma / Biotech), AI ExpertRecently posted Auto Apply
Weekday AI · United States · Remote · Posted 19 Nov 2026 🇺🇸
ArticulateGenerative AIHealthcare$70 - $100/hr - HR
Lead Quant Researcher, Event Driven SignalsRecently posted Auto Apply
hermeneutic research · United States · Remote · Posted 19 Nov 2026 🇺🇸
SQLBootstrapDerivatives+4Salary not listed - ON

Applied Scientist, Foundation ModelsRecently posted Auto Apply
Oneapp · United States · Remote · Posted 19 Nov 2026 🇺🇸
Talent Acquisition$180k - $250k/yr - AP

Associate Scientist III, BioassaysRecently posted Auto Apply
Arrowhead Pharmaceuticals · Madison · Hybrid · Posted 19 Nov 2026 🇺🇸
$80k - $90k/yr - AP

Scientist I, Quality Control (Validation)Recently posted Auto Apply
Arrowhead Pharmaceuticals · Verona · Hybrid · Posted 19 Nov 2026 🇺🇸
$90k - $105k/yr - AP

Associate Scientist I, Mechanistic PharmacologyRecently posted Auto Apply
Arrowhead Pharmaceuticals · Madison · Hybrid · Posted 18 Nov 2026 🇺🇸
Healthcare$55k - $68k/yr - TT
Physics Expert, Quantum Optics and Atomic PhysicsRecently posted Auto Apply
True Talent Solutions Partners · United States · Remote · Posted 19 Nov 2026 🇺🇸
Auditing$100 - $170/hr - LA

Principal Scientist - Analytical Development & Quality ControlRecently posted Auto Apply
Landmarkbio · Watertown · On-site · Posted 18 Nov 2026 🇺🇸
ComplianceContinuous Improvement$150k - $180k/yr