Quick overview
Job description
About the Role
Join a post-training research team at a Series A AI training data company. You will design controlled experiments to determine how training data affects model capabilities, generalization, and alignment, then turn the findings into practical recommendations.
What You'll Do
Run controlled supervised fine-tuning (SFT) and reinforcement learning (RL) experiments to measure dataset impact on model performance.
Help develop public evaluations and new data types that advance model training and assessment.
Build shared evaluation infrastructure and benchmarks to make results reproducible across models, capabilities, and domains.
Publish external research, blog posts, and technical reports.
Collaborate with internal teams to improve data quality based on experimental results.
What We're Looking For
Zero to four years of experience in research or machine learning roles building or delivering LLM training, evaluation, or post-training systems.
Experience at a frontier AI lab and a track record of independently designing, implementing, and analyzing controlled experiments.
Strong familiarity with LLM training and evaluation methodologies, including hands-on SFT and RL post-training.
Ability to design lightweight experiments and draw actionable insights from messy results.
Experience working across domains such as finance, software engineering, and policy.
Software engineering skills and experience independently building or modifying evaluation harnesses, training pipelines, benchmarks, or related experimental infrastructure.
Meaningful research or publications in model evaluation, post-training, or data curation.
Compensation & Benefits
Base salary: $150,000 to $250,000 annually. Visa sponsorship is available.
Location
On-site in San Francisco, California, United States.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- IN

Associate Scientist III, Metabolic DiseasesRecently posted Auto Apply
Insitro · South San Francisco · Hybrid · Posted 16 Nov 2026 🇺🇸
EchoDiversity & InclusionMachine Learning+1$120.3k - $129k/yr - SG
Senior Dietary Residue ScientistRecently posted Auto Apply
Syngenta Group · Greensboro, North Carolina · On-site · Posted 16 Nov 2026 🇺🇸
Data Analysis$104.8k - $157.2k/yr - LL
Physical Metallurgy and Materials Processing - Postdoctoral ResearcherRecently posted Auto Apply
LLNL · Livermore, CA · On-site · Posted 16 Nov 2026 🇺🇸
SEMHealthcare$123.0k/yr - LL
Energetic Materials Experimentalist - Postdoctoral ResearcherRecently posted Auto Apply
LLNL · Livermore, CA · On-site · Posted 16 Nov 2026 🇺🇸
MATLABPythonData AnalysisHealthcare$123.0k/yr - EU
ELISA ScientistRecently posted Auto Apply
Eurofins · West Point, PA · On-site · Posted 16 Nov 2026 🇺🇸
Microsoft ExcelMicrosoft OfficeMicrosoft PowerPoint+3Salary not listed - EU
Scientist II - Laboratory InvestigationsRecently posted Auto Apply
Eurofins · Columbia, MO · On-site · Posted 16 Nov 2026 🇺🇸
Microsoft OfficeData AnalysisTechnologySalary not listed - EU
Automation ScientistRecently posted Auto Apply
Eurofins · West Point, PA · On-site · Posted 16 Nov 2026 🇺🇸
Data AnalysisSalary not listed - EU
Molecular Scientist (NGS)Recently posted Auto Apply
Eurofins · Spring House, PA · On-site · Posted 16 Nov 2026 🇺🇸
SpringMicrosoft OfficeData AnalysisSalary not listed - EU
Scientist - 3rd ShiftRecently posted Auto Apply
Eurofins · Portage, MI · On-site · Posted 16 Nov 2026 🇺🇸
Technology€7.3k/mo - SE
Principal Research Engineer/ScientistRecently posted Auto Apply
ServiceNow · Santa Clara, California · On-site · Posted 16 Nov 2026 🇺🇸
Engineering$276.1k - $483.2k/yr - OP

Director, Analytical SciencesRecently posted Auto Apply
ORIC Pharmaceuticals · San Diego, CA · Hybrid · Posted 16 Nov 2026 🇺🇸
$200k - $230k/yr - AB

Principal Scientist II, Precision Medicine ImmunologyRecently posted Auto Apply
AbbVie · Waltham, MA · Hybrid · Posted 16 Nov 2026 🇺🇸
Clinical TrialsComplianceRegulatory Compliance+2Healthcare$141.5k - $268.5k/yr