
Lead Technology Product Manager – AI Quality & Evaluation
Why this role stands out
Step into a pivotal role at SysTech International where you will shape the future of responsible AI through innovative quality and evaluation strategies. This position is perfect for a collaborative product leader who thrives on building scalable solutions and enjoys the perfect balance of professional growth and hybrid flexibility. Apply today to lead high-impact initiatives and advance your career at a company dedicated to setting the industry standard for AI excellence.
Quick overview
Job description
Lead Technology Product Manager – AI Quality & Evaluation
Locations: Waltham, MA | Philadelphia, PA | Coppell, TX | Other eligible U.S. office locations
Work Arrangement: Hybrid – 8 days per month onsite
Employment Type: Full-Time
Job Summary
We are seeking a Lead Technology Product Manager specializing in AI Quality & Evaluation to translate quality standards and evaluation strategies into scalable product capabilities. This role focuses on AI evaluation workflows, automation, monitoring, quality reporting, and responsible AI practices.
The ideal candidate will have strong product management experience and the ability to collaborate with clinical, engineering, data science, compliance, and business teams.
Key Responsibilities
- Translate quality standards and evaluation methodologies into product requirements and roadmap priorities.
- Lead product discovery and delivery for AI evaluation tools, workflows, automation, and reporting capabilities.
- Define requirements for review workflows, issue triage, launch readiness, and post-launch monitoring.
- Partner with engineering, data science, clinical, legal, compliance, and customer-facing teams.
- Identify opportunities to automate evaluation processes while maintaining appropriate expert oversight.
- Use evaluation insights to improve product quality, user experience, content quality, and model behavior.
- Define metrics, dashboards, and decision criteria for measuring AI quality and performance.
- Monitor emerging practices in AI evaluation, benchmarking, and responsible AI.
- Communicate product decisions, quality outcomes, risks, and recommendations to stakeholders.
Required Qualifications
- 5+ years of product management experience in healthcare, enterprise SaaS, data-driven products, platform products, quality, or related fields.
- Strong experience in product discovery, requirements definition, roadmap planning, experimentation, and product execution.
- Ability to translate complex technical, clinical, quality, and risk concepts into practical product requirements.
- Experience working with engineering, data science, clinical, compliance, or operational teams.
- Strong analytical skills and experience defining metrics, dashboards, workflows, and decision criteria.
- Excellent communication and stakeholder management skills.
- Interest in AI technologies, evaluation methodologies, responsible AI, and emerging technology trends.
Preferred Qualifications:
- Experience with AI-enabled products, healthcare technology, data products, search/retrieval quality, or decision-support systems.
- Familiarity with AI evaluation methods, benchmarks, monitoring, automation, and human-in-the-loop review.
- Experience in healthcare, clinical workflows, regulated environments, or professional-information products.
Candidates must be comfortable with the stated hybrid work arrangement and eligible U.S. office locations.
Similar jobs
- KT

Product OwnerRecently posted
Kforce Technology Staffing · Kansas City, MO · Hybrid · Posted 17 Nov 2026 🇺🇸
SAFeScrumAgile+1Operations & Project ManagementSalary not listed - VI

Product Manager, Consumer Credit CommercializationRecently posted
Visa · San Francisco, California · Hybrid · Posted 17 Nov 2026 🇺🇸
Pipeline ManagementSales$156.8k - $251.1k/yr - VI

Product Manager, Consumer Credit Partner Management & CommercializationRecently posted
Visa · San Francisco, California · Hybrid · Posted 17 Nov 2026 🇺🇸
Sales$156.8k - $251.1k/yr - NM

Senior Product Manager - Finance & RiskRecently posted
Northwestern Mutual · Milwaukee, WI · Hybrid · Posted 17 Nov 2026 🇺🇸
Stakeholder ManagementScrumAgileFinance$119.0k/yr - LA
Senior Product Owner – ServiceNowRecently posted
LetitBeX AI Tech Solutions LLC · Washington, DC · Hybrid · Posted 17 Nov 2026 🇺🇸
SAFeConfluenceContinuous Improvement+2TechnologySalary not listed - QT

Product Manager with SalesforceRecently posted
QUANTUM TECHNOLOGIES LLC · United States · Hybrid · Posted 17 Nov 2026 🇺🇸
Stakeholder ManagementScrumCRM+2Technology$86/hr - KT

Data Science Product ManagerRecently posted
Kforce Technology Staffing · Queens, NY · Hybrid · Posted 17 Nov 2026 🇺🇸
Stakeholder ManagementData AnalysisTechnologySalary not listed - KT

SWIFT Payment Product OwnerRecently posted
Kforce Technology Staffing · Saint Paul, MN · Hybrid · Posted 17 Nov 2026 🇺🇸
AgileOperations & Project ManagementSalary not listed - TT
Product Manager, Supply ChainRecently posted Auto Apply
True Talent Solutions Partners · Los Angeles · On-site · Posted 17 Nov 2026 🇺🇸
OnboardingAWSRobotics+9Operations & Project Management$175k - $200k/yr - TT
Product Lead, Agentic PersonalizationRecently posted Auto Apply
True Talent Solutions Partners · Remote · Remote · Posted 17 Nov 2026 🇺🇸
Customer SuccessMachine Learning$240k - $320k/yr - UB

Product Manager II - ProductRecently posted Auto Apply
Uber · New York City · Hybrid · Posted 17 Nov 2026 🇺🇸
A/B TestingOperations & Project Management$161k - $179k/yr - PE

Lead Specialist, Product ManagementRecently posted Auto Apply
Pearson · United States · Hybrid · Posted 17 Nov 2026 🇺🇸
A/B TestingContinuous ImprovementLLM+4$140k - $170k/yr