Quick overview
Job description
About the Role
Join an early-stage AI company building post-training methods and infrastructure for production AI agents. In this research engineering role, you will connect machine learning research with practical systems, helping improve model quality, cost, and latency in real-world workflows.
What You'll Do
Build evaluation suites, graders, and data pipelines using production workflows and traces.
Lead post-training work, including data preparation, evaluations, reinforcement learning environments, and training runs.
Implement agent environments and harnesses for reproducible experiments and training data generation.
Run and analyze post-training experiments, reproduce promising research, and debug related systems.
Turn successful experiments into reliable components for post-training and continual learning systems.
What We're Looking For
One to five years of engineering experience at an AI startup or in an ML research group, working hands-on with large language models in post-training, evaluation, or inference.
Strong programming skills, especially in Python, and solid machine learning and computer science fundamentals.
Hands-on experience training, evaluating, and serving LLMs, beyond using model APIs or prompt and agent wrappers.
Experience with tools and systems such as PyTorch, JAX, LLM training, evaluation harnesses, model serving, vLLM, SGLang, Megatron, or reinforcement learning environments.
A shipped system, engineering work, open-source contribution, or substantive research project that demonstrates technical depth and personal ownership.
Clear interest in post-training or inference, with the ability to learn unfamiliar systems, debug independently, and measure whether solutions work.
Compensation & Benefits
Base salary is $200,000 to $300,000 USD annually. Visa sponsorship is available.
Location
On-site in Palo Alto, California, five days per week.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- TT
Lead Software Engineer, PlatformRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 14 Nov 2026 🇺🇸
RustPythonScheduling+1Technology$220k - $320k/yr - TT
Software Engineer, MarketplaceRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 14 Nov 2026 🇺🇸
OnboardingKafkaOutreach+5Technology$250k - $300k/yr - PC
Survey and Research Programmer Auto Apply
ProSidian Consulting, LLC · Charlotte, NC · On-site 🇺🇸
Microsoft ExcelMicrosoft OfficeMicrosoft Word+6Salary not listed - PC
Senior Programmer Analyst Auto Apply
ProSidian Consulting, LLC · Rockville, MD · On-site 🇺🇸
Microsoft ExcelMicrosoft OfficeMicrosoft Word+2Operations & Project ManagementSalary not listed - PC
Junior Programmer Analyst Auto Apply
ProSidian Consulting, LLC · Rockville, MD · On-site 🇺🇸
Microsoft ExcelMicrosoft OfficeMicrosoft Word+1TechnologySalary not listed - PC
Engineer Auto Apply
ProSidian Consulting, LLC · Charlotte, NC · On-site 🇺🇸
Microsoft ExcelMicrosoft OfficeMicrosoft Word+2EngineeringSalary not listed - PC
Engineering Intern | Engineering [COC0099296] Auto Apply
ProSidian Consulting, LLC · Charlotte, NC · On-site 🇺🇸
Microsoft ExcelMicrosoft OfficeMicrosoft PowerPoint+2EngineeringSalary not listed - NM
Sec Systs Software Programmer Auto Apply
Northwestern Memorial Healthcare · Chicago, IL · On-site · Posted 19 Oct 2026 🇺🇸
MongoDBSQLKafka+5Technology$46 - $67/hr - BG
Service Engineer Intern Auto Apply
Bosch Group · Lincolnshire, IL · On-site 🇺🇸
Microsoft ExcelEngineering$18 - $28/hr - VE

Senior Test Engineer, CamerasRecently posted Auto Apply
Verkada · San Mateo · Hybrid · Posted 13 Nov 2026 🇺🇸
ShellGitEmbedded Systems+10Technology$150k - $220k/yr - SK
Principal Software Engineer, Lead (U.S. Air Force)Recently posted Auto Apply
Skylight · United States · Hybrid · Posted 13 Nov 2026 🇺🇸
SQLiteGitAWS+11Technology$90k - $125k/yr - EV

Principal Sofware Engineer, Applied AIRecently posted Auto Apply
Everpure · Santa Clara · Hybrid · Posted 14 Nov 2026 🇺🇸
ComplianceKubernetesEngineering$203k/yr