Quick Overview
Job Description
About the Role
Lead complex data and evaluation programs for AI research teams and internal partners. You will turn evolving technical needs into reliable delivery processes and help ensure data and evaluations meaningfully improve AI models and agents.
What You'll Do
Own programs from scoping and requirements gathering through production, quality assurance, delivery, and retrospectives.
Translate ambiguous requests into clear specifications with milestones, owners, dependencies, and acceptance criteria.
Assess and improve data quality using quantitative metrics and qualitative review, including task coverage, difficulty, and reward distributions.
Manage external vendors and improve delivery pipelines as programs scale.
Improve workflows, documentation, automation, and cross-functional handoffs for data production and evaluation.
Partner with research, platform, and marketplace teams to turn feedback into product improvements.
What We're Looking For
At least 3 years of experience owning complex technical programs in AI/ML, data operations, support engineering, applied research, forward-deployed engineering, or a related cross-functional area.
Experience as a Technical Program Manager or Strategic Program Lead at a startup.
Ability to structure ambiguous technical requirements and maintain momentum as needs change.
Experience improving data quality processes and evaluating datasets through both aggregate metrics and individual examples.
Experience managing vendors, scaling delivery pipelines, and supporting AI research teams or technical enterprise customers with changing requirements.
Familiarity with RLHF, reinforcement-learning environments, agent evaluations, human-in-the-loop data pipelines, annotation, or expert data collection is valuable.
Strong written and verbal communication skills, sound judgment, and the ability to work independently in a fast-paced environment.
Compensation & Benefits
Salary range: $130,000 to $225,000 USD annually. Visa sponsorship is available for full-time candidates.
Location
On-site in San Francisco, California, United States.
Similar jobs
- TO
Workplace Program Manager
NewAuto ApplyToast
Boston🇺🇸Hybrid11 hours agoEnvoyScrumAgile+2Operations & Project Management - VE
Overnight Program Director
NewAuto ApplyVivvi Early Learning
Liberty🇺🇸Hybrid11 hours agoComplianceLesson PlanningOnboarding+2 - VE
Weekend Program Director
NewAuto ApplyVivvi Early Learning
Liberty🇺🇸Hybrid11 hours agoComplianceLesson PlanningOnboarding+2 - EV
Program Manager, Global Supply Chain Network Design
NewAuto ApplyEverpure
Santa Clara🇺🇸Hybrid7 hours agoScrumTableauAgile+4Operations & Project Management - OP
Data Program Manager, Science
NewAuto ApplyOpenai
San Francisco🇺🇸Hybrid11 hours agoSQLBackground ChecksCompliance+3Operations & Project Management - LA
Technical Program Manager - Data Center Infrastructure Delivery
NewAuto ApplyLambda
Remote🇺🇸Remote11 hours agoFiberShellMachine Learning+3Technology - LO
Learning & Development Program Manager
NewAuto ApplyLoenbro
Dallas🇺🇸Hybrid7 hours agoContinuous ImprovementFLSALMS+3Operations & Project Management - KU
Technical Program Manager
NewAuto ApplyKunai
Remote - United States🇺🇸Remote14 hours agoAgileConfluenceJiraOperations & Project Management - KS
Senior Compliance Program Manager, GRC
NewAuto ApplyKeeper Security
Remote🇺🇸Remote7 hours agoPCI DSSSOC 2Compliance+7Operations & Project Management - HI
Senior Technical Program Manager
Auto ApplyHuman Interest
United States🇺🇸$200k - $220k/yrRemote6 days agoAgileBookkeepingCompliance+4Operations & Project Management - WH
Technical Program Manager (NPI)
NewAuto ApplyWhoop
Boston🇺🇸$120k - $160k/yrOn-site12 hours agoAssemblyOperations & Project Management - UT
Senior Technical Program Manager
NewAuto ApplyUnited Talent Agency
Los Angeles Office🇺🇸$160k - $190k/yrOn-site11 hours agoGCPAWSSnowflake+4Operations & Project Management