Quick overview
Job description
About the Role
Join a post-training research team at an applied AI research company focused on training data for foundation models. You will design controlled experiments to determine how datasets affect model behavior, then turn the findings into practical improvements to data and evaluation.
What You'll Do
Run controlled supervised fine-tuning (SFT) and reinforcement learning experiments to measure dataset impact on model performance.
Build evaluation infrastructure and benchmarks that support reproducible comparisons across models, capabilities, and domains.
Help develop public evaluations and new data types for frontier models.
Publish external-facing research, blog posts, and technical reports.
Collaborate with internal teams to improve data quality based on experimental findings.
What We're Looking For
Zero to four years of experience building or delivering work in LLM training, post-training, or model evaluation.
Experience at a frontier AI lab.
Strong familiarity with LLM training and evaluation methods, including the ability to independently design, implement, and analyze controlled experiments.
Ability to build or modify experimental infrastructure, such as evaluation harnesses, training pipelines, or benchmarks.
Comfort moving quickly, interpreting messy results, and extracting actionable insights.
Experience working across domains such as finance, software engineering, and policy.
Meaningful research or hands-on work in model evaluation, post-training, or data curation is valuable.
Compensation & Benefits
Base salary: $150,000 to $250,000 annually. Visa sponsorship is available.
Location
On-site in San Francisco, California, United States.
Similar jobs
- HY
Senior AI Scientist Auto Apply
Hyperfine · Guilford · Hybrid 🇺🇸
Computer VisionDeep LearningPatient Care+4Salary not listed - HY
Senior AI Scientist Auto Apply
Hyperfine · Palo Alto · Hybrid 🇺🇸
Computer VisionDeep LearningPatient Care+4Salary not listed - GL

Food Scientist Auto Apply
GT'S Living Foods · Los Angeles · Hybrid 🇺🇸
SourcingComplianceFood Safety+2Salary not listed - TT
AI Research ScientistRecently posted Auto Apply
True Talent Solutions Partners · Remote · Remote 🇺🇸
PythonMachine LearningSalary not listed - TC

Research Scientist Manager/Director, Health Economics Auto Apply
Thyme Care · Remote · Remote 🇺🇸
SQLMicrosoft ExcelLooker+4Salary not listed - MU

Scientist II Auto Apply
Multiplylabs · San Francisco · On-site 🇺🇸
RoboticsCustomer Success$115k - $135k/yr - CR
Researcher, Online Threat IntelligenceRecently posted Auto Apply
Control Risks · Washington, District of Columbia · Hybrid 🇺🇸
Technology$60k - $65k/yr - ST

Senior / Principal Associate Scientist, Advanced Cell EngineeringRecently posted Auto Apply
Strand Therapeutics · Boston · Hybrid 🇺🇸
Microsoft ExcelMicrosoft PowerPointData AnalysisEngineering$84k - $112k/yr - OT

Director of AI ResearchRecently posted Auto Apply
Otter.ai · Mountain View · Hybrid 🇺🇸
DjangoFastAPIPyTorch+3Salary not listed - MB
Sr. Material ResearcherRecently posted Auto Apply
Material Bank · South Florida or Boston · Hybrid 🇺🇸
OnboardingSalary not listed - LS

Co-Op, Reaction Prediction & BenchmarkingRecently posted Auto Apply
Lila Sciences · Cambridge · Hybrid 🇺🇸
Talent AcquisitionPythonMachine LearningSalary not listed - LS

Co-Op, Materials Science, Heterogeneous CatalysisRecently posted Auto Apply
Lila Sciences · Cambridge · Hybrid 🇺🇸
Talent AcquisitionMATLABPython+1Salary not listed