Quick overview
Job description
About the Role
Join a post-training research team focused on measuring how training data affects model behavior. You will run controlled SFT and reinforcement learning experiments, then turn the results into practical recommendations for improving data quality and model performance.
What You'll Do
Design, run, and analyze controlled SFT and RL experiments to assess dataset impacts on model capabilities, generalization, and alignment.
Help build evaluation infrastructure and benchmarks that make results reproducible across models, capabilities, and domains.
Develop public evaluations and data types that support frontier model research.
Publish research, technical reports, and blog posts that communicate findings clearly.
Collaborate with internal partners and research labs to improve data quality based on experimental results.
What We're Looking For
Zero to four years of experience building or delivering work in LLM training, post-training, or model evaluation.
Experience at a frontier AI lab and strong familiarity with LLM training and evaluation methods.
Ability to independently design, implement, and analyze controlled experiments, including when results are messy or inconclusive.
Software engineering skills to build or modify experimental infrastructure, such as evaluation harnesses, training pipelines, or benchmarks.
Experience working across domains such as finance, software engineering, and policy.
A practical, builder-oriented approach; meaningful research or end-to-end post-training experiments are valuable.
Compensation & Benefits
Base salary: $150,000 to $250,000 annually. Visa sponsorship is available.
Location
On-site in San Francisco, California, United States.
Similar jobs
- KC

Scientist II - LC-MS/MS Bioanalysis (Method Development)Recently posted Auto Apply
Kcasbio · Kansas City · On-site 🇺🇸
ComplianceOutreachSalary not listed - AT

Principal Scientist – Oligonucleotide & AOC Analytical ChemistryRecently posted Auto Apply
Atrium Therapeutics · San Diego · On-site 🇺🇸
Data Analysis$185k - $205k/yr - EU
Associate Scientist: Stability and Batch ReleaseRecently posted Auto Apply
Eurofins · Columbia, MO · On-site 🇺🇸
Salary not listed - SE
Manager, Thought Leadership Research StrategistRecently posted Auto Apply
ServiceNow · Austin, TEXAS · Remote 🇺🇸
Market ResearchData AnalysisMarketingSalary not listed - AB

Senior Scientist I, Biomolecular InteractionsRecently posted Auto Apply
AbbVie · Worcester, MA · On-site 🇺🇸
InstagramYouTube$96.5k - $183.5k/yr - HU

Senior Scientist II- Hepatocyte and Liver Tissue EngineeringRecently posted Auto Apply
Harvard University · Boston, MA · On-site 🇺🇸
Intellectual PropertyMental HealthProcurement+1EngineeringSalary not listed - AB

Senior Scientist, I - Drug Product Design & DevelopmentRecently posted Auto Apply
AbbVie · North Chicago, IL · On-site 🇺🇸
ComplianceInstagramYouTube$96.5k - $183.5k/yr - AB

Senior Principal Research ScientistRecently posted Auto Apply
AbbVie · North Chicago, IL · On-site 🇺🇸
ComplianceInstagramYouTube$160.5k - $305k/yr - AB

Principal Scientist II, AI-Guided Antibody Drug Conjugate DesignRecently posted Auto Apply
AbbVie · Worcester, MA · On-site 🇺🇸
Deep LearningGenerative AIMachine Learning+2$141.5k - $268.5k/yr - DO
Director/AD, Computational DMPK (Drug Metabolism & Pharmacokinetics)Recently posted Auto Apply
Deep Origin · United States · Remote 🇺🇸
EnzymePythonMachine LearningHealthcareSalary not listed - ST

Director, Clinical ScientistRecently posted Auto Apply
Summit Therapeutics · Remote (US) · Remote 🇺🇸
Talent AcquisitionClinical Research$192k - $239k/yr - PP

Principal Scientist, Analytical Development, Oligo and Small MoleculeRecently posted Auto Apply
Praxis Precision Medicines, Inc. · United States - Remote · Remote 🇺🇸
Diversity & InclusionAgile$165k/yr