Quick overview
Job description
About the Role
Own complex, time-sensitive data and evaluation programs for AI research teams and internal partners. This role works across technical program management, data operations, and vendor coordination to turn ambiguous requests into reliable programs that improve LLM and agent evaluation.
What You'll Do
Lead data and evaluation programs from scoping and requirements gathering through production, quality assurance, delivery, and retrospectives.
Turn ambiguous technical requests into clear specifications with milestones, owners, dependencies, and acceptance criteria.
Improve data quality processes using quantitative measures and qualitative review, including analysis of task coverage, difficulty, and reward distributions.
Manage external vendors through the delivery lifecycle and strengthen scalable delivery pipelines.
Improve workflows, documentation, automation, and cross-functional handoffs for data production and evaluation.
Partner with research, platform, and marketplace teams to turn findings into product improvements.
What We're Looking For
At least 3 years of experience owning complex technical programs in AI/ML, data operations, support engineering, applied research, forward-deployed engineering, or a related cross-functional field.
Experience as a Technical Program Manager or strategic program lead at a startup, with a record of bringing structure to changing or ambiguous requirements.
Strong quantitative and qualitative judgment, including the ability to assess aggregate dataset metrics and inspect individual examples.
Experience improving data quality procedures, managing external vendors, and supporting technical customers or research teams with urgent, evolving needs.
Background in RLHF, reinforcement-learning environments, agent evaluations, human-in-the-loop data pipelines, annotation workflows, or expert data collection is valuable.
Strong communication skills and comfort working independently in a fast-paced environment.
Compensation & Benefits
Base salary is $130,000 to $225,000 annually. Visa sponsorship and relocation support are available for qualified full-time candidates.
Location
On-site in San Francisco, California. Candidates based remotely may be considered if they can maintain 70% to 80% time zone overlap with San Francisco or Singapore.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- TA

Lead Technical Program Manager, RoboticsRecently posted Auto Apply
The Allen Institute for Artificial Intelligence · Seattle · Hybrid · Posted 18 Nov 2026 🇺🇸
Stakeholder ManagementRoboticsCapacity Planning+1Operations & Project Management$159.8k - $239.8k/yr - SE

Technical Program Manager, Product & Technology Strategic PartnershipsRecently posted Auto Apply
SentinelOne · United States - Remote · Remote · Posted 18 Nov 2026 🇺🇸
Project ManagementOperations & Project Management$132k - $182k/yr - RE

Staff Technical Program ManagerRecently posted Auto Apply
Rondo Energy · Alameda · Hybrid · Posted 18 Nov 2026 🇺🇸
RecruitingCADProject ManagementOperations & Project ManagementSalary not listed - EC

Behavioral Health Integration (BHI) Program DirectorRecently posted Auto Apply
Ennoble Care · Marlton · Hybrid · Posted 18 Nov 2026 🇺🇸
OnboardingWorkforce PlanningCompliance+3Healthcare$110k - $125k/yr - AP

Senior Technical Program Manager, ElectronicsRecently posted Auto Apply
Apptronik · Austin · Hybrid · Posted 18 Nov 2026 🇺🇸
RoboticsScrumCompliance+5Operations & Project ManagementSalary not listed - AP

Staff Technical Program Manager, Physical AIRecently posted Auto Apply
Apptronik · Austin · Hybrid · Posted 18 Nov 2026 🇺🇸
RoboticsComplianceRegulatory ComplianceOperations & Project ManagementSalary not listed - AP

Staff Technical Program Manager, Physical AIRecently posted Auto Apply
Apptronik · Sunnyvale · Hybrid · Posted 18 Nov 2026 🇺🇸
RoboticsArticulateCapacity Planning+5Operations & Project Management$240k - $280k/yr - FO
Program ManagerRecently posted Auto Apply
Fooda · Abilene, Texas · On-site · Posted 17 Nov 2026 🇺🇸
Microsoft ExcelOperations & Project ManagementSalary not listed - IE

Senior Program ManagerRecently posted Auto Apply
Inizio Evoke · San Francisco · Hybrid · Posted 17 Nov 2026 🇺🇸
AgileProject ManagementOperations & Project Management$140k - $170k/yr - IE

Senior Program ManagerRecently posted Auto Apply
Inizio Evoke · New York · Hybrid · Posted 17 Nov 2026 🇺🇸
AgileProject ManagementOperations & Project Management$140k - $170k/yr - AI

Staff Technical Program Manager, Advanced Targeting SystemsRecently posted Auto Apply
Anduril Industries · Costa Mesa · Hybrid · Posted 17 Nov 2026 🇺🇸
Stakeholder ManagementProcess ImprovementVendor ManagementOperations & Project Management$132k - $198k/yr - WA

People Operations Program Manager – People Systems & Process DesignRecently posted Auto Apply
Waymo · Mountain View · Hybrid · Posted 17 Nov 2026 🇺🇸
Generative AIJiraOperations & Project Management$159k/yr
