Quick overview
Job description
About the Role
Own complex, time-sensitive data and evaluation programs for AI research teams and internal partners. This role sits at the intersection of technical program management, data operations, and vendor coordination, building the processes and operating rhythms needed to deliver high-quality data that improves model and agent evaluation.
What You'll Do
Lead data and evaluation programs from scoping and requirements gathering through production, quality assurance, delivery, and retrospective.
Turn ambiguous requests into clear specifications with milestones, owners, dependencies, and acceptance criteria.
Assess and improve data quality using quantitative signals and qualitative review, including task coverage, difficulty, and reward distributions.
Manage external vendors across the delivery lifecycle and scale delivery pipelines.
Improve workflows, documentation, automation, and cross-functional handoffs for data production.
Partner with research, platform, and marketplace teams to turn operational learnings into product improvements.
What We're Looking For
At least 3 years of experience owning complex technical programs, including work as a Technical Program Manager or Strategic Program Lead at a startup.
Experience in AI/ML, data operations, support engineering, applied research, or a similarly cross-functional environment.
Familiarity with RLHF, reinforcement-learning environments, agent evaluations, human-in-the-loop data pipelines, annotation workflows, or expert data collection.
Experience managing external vendors, scaling delivery pipelines, and improving data quality through metrics and qualitative inspection.
Background supporting AI research teams, technical enterprise customers, or other partners with urgent and evolving requirements.
Strong quantitative and qualitative judgment, communication skills, and ability to bring structure to ambiguous work.
Compensation & Benefits
Base salary is $130,000 to $225,000 annually. Visa sponsorship is available.
Location
On-site in San Francisco or Singapore, with remote candidates considered in the United States or Singapore.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- ME

Sr. Project Manager (IT PM) (6870)Recently posted Auto Apply
MetroStar · Reston · Hybrid · Posted 19 Nov 2026 🇺🇸
GitScrumCompliance+5Operations & Project Management$156k - $190k/yr - CA

Business Analyst, Infrastructure & Pricing StrategyRecently posted Auto Apply
Cantina · San Francisco · Hybrid · Posted 20 Nov 2026 🇺🇸
SQLMicrosoft ExcelGoogle Workspace+1Operations & Project Management$110k - $130k/yr - FI
Technical Business Analyst / Product AnalystRecently posted Auto Apply
Federal IT Consulting (FEDITC) · Remote - US · Remote · Posted 19 Nov 2026 🇺🇸
SAFeSQLMicrosoft Office+15Operations & Project ManagementSalary not listed - DI

Staff Product Manager, Data ServicesRecently posted Auto Apply
DigitalOcean · Seattle · Hybrid · Posted 19 Nov 2026 🇺🇸
SQLApacheCapacity Planning+4Operations & Project Management$186.4k - $233k/yr - ER

Program Coordinator PRNRecently posted Auto Apply
Eating Recovery Center · IL-Chicago Erie · Hybrid · Posted 19 Nov 2026 🇺🇸
ProcurementOperations & Project Management$18 - $29/hr - VE

Data & AI Product Manager (Staff)Recently posted Auto Apply
Vendelux · New York · Hybrid · Posted 19 Nov 2026 🇺🇸
SQLEvent MarketingHubSpot+2Operations & Project ManagementSalary not listed - VE

Data & AI Product Manager (Senior)Recently posted Auto Apply
Vendelux · New York · Hybrid · Posted 19 Nov 2026 🇺🇸
SQLEvent MarketingHubSpot+2Operations & Project ManagementSalary not listed - DA
Senior Learning Program ManagerRecently posted Auto Apply
DAT · Denver · Hybrid · Posted 20 Nov 2026 🇺🇸
Stakeholder ManagementOnboardingCompliance+2Operations & Project Management$119k - $157k/yr - AL
Sr. Product Manager, Data AnalyticsRecently posted Auto Apply
Allego · Waltham · Hybrid · Posted 19 Nov 2026 🇺🇸
SnowflakeTableauCustomer Success+4Operations & Project Management$156k - $220k/yr - TR

Business and Operations LeadRecently posted Auto Apply
Trustly · New York · Hybrid · Posted 19 Nov 2026 🇺🇸
Talent AcquisitionOperations & Project ManagementSalary not listed - RU

Founding Product Manager, Control PlaneRecently posted Auto Apply
Runlayer · NYC · Hybrid · Posted 19 Nov 2026 🇺🇸
Generative AIOperations & Project ManagementSalary not listed - SA

Growth Strategy & Operations ManagerRecently posted Auto Apply
Saronic · Austin · On-site · Posted 19 Nov 2026 🇺🇸
Microsoft ExcelMicrosoft PowerPointTableau+8Operations & Project ManagementSalary not listed
