Quick overview
Job description
About the Role
Join a post-training research team at an applied AI data company focused on improving foundation models. You will design controlled experiments to measure how training data influences model capabilities, generalization, and alignment, then turn findings into practical recommendations.
What You'll Do
Run controlled supervised fine-tuning and reinforcement learning experiments to measure the impact of datasets on model performance.
Help develop evaluation benchmarks and new data types that advance model training and assessment.
Build shared evaluation infrastructure to make findings reproducible across models, capabilities, and domains.
Publish external research, technical reports, and blog posts based on your work.
Use experimental results to help improve data quality and production.
Collaborate with external research partners to communicate clear evidence about data-driven improvements and the conditions behind them.
What We're Looking For
Zero to four years of experience building or delivering work in LLM training, post-training, or model evaluation.
Prior experience at a frontier AI lab.
Strong familiarity with LLM training and evaluation methodologies, including SFT and RL-based post-training.
Experience independently designing, implementing, and analyzing controlled experiments, and extracting useful conclusions from imperfect results.
Software engineering skills to build or modify experimental infrastructure, such as evaluation harnesses, training pipelines, or benchmarks.
Ability to work across domains such as finance, software engineering, and policy, with a practical, builder-oriented approach.
Research experience in model evaluation, post-training, or data curation is valuable.
Compensation & Benefits
Base salary: $150,000 to $250,000 annually. Visa sponsorship is available.
Location
On-site in San Francisco, California, United States.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- BI

Senior Analyst - ADA/PK Auto Apply
Bioagilytix · Durham · On-site 🇺🇸
ComplianceSchedulingSalary not listed - AR

Member of Technical Staff - Research ScientistRecently posted Auto Apply
Architect · Palo Alto · On-site · Posted 14 Nov 2026 🇺🇸
ConcreteSalary not listed - SE

Senior Research Scientist, Modeling & System DesignRecently posted Auto Apply
Securebio · Cambridge · On-site · Posted 13 Nov 2026 🇺🇸
ConcretePythonSystem Design$185k - $210k/yr - CO

AI Researcher Auto Apply
Continualresearch · New York City · On-site 🇺🇸
Machine Learning$150k - $250k/yr - JH
Clinical Health ScientistRecently posted Auto Apply
J.S. Held LLC · Redmond, WA · Remote · Posted 13 Nov 2026 🇺🇸
Microsoft ExcelMicrosoft OfficeMicrosoft PowerPointOperations & Project Management$85/hr - EU
Senior Scientist — Regulatory Cardiac Safety/Electrophysiology (Scientist II)Recently posted Auto Apply
Eurofins · Saint Charles, MO · On-site · Posted 14 Nov 2026 🇺🇸
Stakeholder ManagementGCPCompliance+3HealthcareSalary not listed - LL
Atomic Spectroscopy – Postdoctoral ResearcherRecently posted Auto Apply
LLNL · Livermore, CA · On-site · Posted 13 Nov 2026 🇺🇸
MATLABPythonHealthcare$123.0k/yr - HU

Research Scientist, The Project on WorkforceRecently posted Auto Apply
Harvard University · Cambridge, MA · Hybrid · Posted 13 Nov 2026 🇺🇸
ComplianceContinuous ImprovementMental HealthHuman ResourcesSalary not listed - AB

Scientist l, Biologics Analytical R&DRecently posted Auto Apply
AbbVie · Irvine, CA · On-site · Posted 13 Nov 2026 🇺🇸
ComplianceInstagramYouTube$75k - $142.5k/yr - AB

Senior Scientist I, Biologics Analytical R&D, CMC Biologics DevelopmentRecently posted Auto Apply
AbbVie · North Chicago, IL · On-site · Posted 12 Nov 2026 🇺🇸
InstagramYouTube$96.5k - $183.5k/yr - CA
Epidemiologist I (2802) - Citywide - H00180Recently posted Auto Apply
City and County of San Francisco · San Francisco, CA · On-site · Posted 12 Nov 2026 🇺🇸
Mental HealthLogistics$97.9k - $119.0k/yr - CA
Epidemiologist II (2803) - Citywide - H00181Recently posted Auto Apply
City and County of San Francisco · San Francisco, CA · On-site · Posted 12 Nov 2026 🇺🇸
Mental HealthLogistics$124.9k/yr