Why this role stands out
Join a highly innovative, award-winning team at the forefront of the AI revolution, where you will drive meaningful impact by shaping the quality and intelligence of enterprise-grade AI agents. This hybrid role is perfect for a strategic, detail-oriented product leader looking to accelerate their career within a fast-growing industry leader, so apply today to help define the future of work.
Quick overview
Job description
About the Role:
As a Product Manager on Glean's AI team, you will own the core systems that make our AI reliable, efficient, and measurably better over time. We're looking for deep skills and hands-on experience in one or both of the following areas:
- Agent harness: experience designing or shipping the execution layer around the model, including planning, tool calling, context management, sub-agents, skills, memory, and long-running tasks, and making the tradeoffs across intelligence, latency, and cost that determine how well agents perform.
- Evaluation: experience building the evalsets, benchmarks, judges, and labeled data that gate launches, compare models and harness changes, and drive continuous hill-climbing on quality.
This is a highly technical, cross-functional IC role. You will work closely with AI engineering, data science, and platform marketing teams, and you will partner with leading model providers and help go-to-market teams turn quality improvements into customer proof points.
You will:
- Set the product strategy and roadmap for your area, grounded in customer workflows, trace data, and eval results.
- Define what "good" looks like for agentic work, including correctness, helpfulness, formatting, efficiency, and reliability, and turn it into clear, measurable launch bars.
- Make evidence-based tradeoffs across models, prompts, tools, and harness changes, balancing quality against latency, cost, and capacity.
- Decide when to use frontier models versus post-training open-weight models for specific tasks, weighing quality, cost, latency, and control, and define the data and evals needed to make post-trained models competitive.
- Build and scale the operating model for evaluation, including datasets, LLM-as-judge systems, human labeling, and benchmarks.
- Turn failed runs, poor traces, and user feedback into prioritized product and quality improvements.
- Partner with model providers and strategic partners on model evaluation, launches, and joint quality work.
- Give the team context, set direction, and build alignment across engineering, data science, and GTM teams without direct authority.
About you:
- You have 4+ years of product management experience, ideally on AI/ML, developer-platform, infrastructure, or quality-tooling products serving large enterprises.
- You have built or worked closely on LLM-powered agents or at-scale AI products, and you understand how harness design choices affect agent behavior.
- You are fluent in LLM evaluation concepts: evalsets, LLM-as-judge, pairwise/side-by-side judging, judge calibration against human labels, benchmarks, and offline-versus-online alignment.
- You are comfortable going deep on agentic systems, including multi-turn tasks, tool use, context and memory management, write actions, and tracing and observability.
- You are rigorous with data and can turn ambiguous quality problems into crisp hypotheses, metrics, and experiments.
- You have a strong technical background and can engage credibly with engineers and data scientists on system design and experiment results.
- You are an excellent written and verbal communicator who enjoys engaging with GTM teams and customers, and you can bridge our technical choices with the outcomes our customers care about.
- You have a proven track record of taking ownership, taking initiative, and delivering results.
- You have a learning and growth mindset, and you are mission-first.
- You are an early adopter of AI in your own product craft, and you use coding agents and AI tools to prototype, analyze, and move faster.
Location:
- This role is hybrid (4 days a week in one of our SF Bay Area offices)
Compensation & Benefits:
The standard base salary range for this position is $200,000 - $300,000 annually. Compensation offered will be determined by factors such as location, level, job-related knowledge, skills, and experience. Certain roles may be eligible for variable compensation, equity, and benefits.
We offer a comprehensive benefits package including competitive compensation, Medical, Vision, and Dental coverage, generous time-off policy, and the opportunity to contribute to your 401k plan to support your long-term goals. When you join, you'll receive a home office improvement stipend, as well as an annual education and wellness stipends to support your growth and wellbeing. We foster a vibrant company culture through regular events, and provide healthy lunches daily to keep you fueled and focused.
We are a diverse bunch of people and we want to continue to attract and retain a diverse range of people into our organization. We're committed to an inclusive and diverse company. We do not discriminate based on gender, ethnicity, sexual orientation, religion, civil or family status, age, disability, or race.
#LI-HYBRID
By clicking “Submit Application,” I confirm that I have read the Global Data Privacy Notice and the Applicant Arbitration Agreement, and I agree to the terms.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- BI

Senior Product Engineer Auto Apply
Bighealth · Remote - US · Remote · Posted 11 Nov 2026 🇺🇸
DjangoNext.jsSupabase+14$140k - $185k/yr - VS

Principal Product Manager, Graph & ReportingRecently posted Auto Apply
Veeam Software · San Jose · Hybrid · Posted 18 Nov 2026 🇺🇸
Microsoft OfficeGenerative AIOperations & Project Management$313.1k/yr - SU

Technical Product Manager - AIRecently posted Auto Apply
SupplyHouse.com · Remote · Remote · Posted 17 Nov 2026 🇺🇸
SAFeStakeholder ManagementAWS+9Technology$122.0k - $152.5k/yr - ZS

Director, Product Management, ZIARecently posted Auto Apply
Zscaler · Santa Clara · Hybrid · Posted 17 Nov 2026 🇺🇸
RecruitingCustomer SuccessDNS+4Salary not listed - PA

Vice President of ProductRecently posted Auto Apply
Paystand · Santa Cruz · Hybrid · Posted 18 Nov 2026 🇺🇸
Accounts PayableAccounts ReceivableBlockchain+5$220k - $250k/yr - FA

Director of Product, Discovery AlgorithmsRecently posted Auto Apply
Faire · New York City · Hybrid · Posted 17 Nov 2026 🇺🇸
Mental HealthMachine Learning$220k - $302.5k/yr - LA

Principal Product Manager - HardwareRecently posted Auto Apply
Lambda · Bellevue Office · Hybrid · Posted 18 Nov 2026 🇺🇸
Capacity PlanningOperations & Project ManagementSalary not listed - ME

Sr. Product Manager I (6841)Recently posted Auto Apply
MetroStar · Tysons Corner · Hybrid · Posted 18 Nov 2026 🇺🇸
AgileOperations & Project Management$166k - $189k/yr - ME

Sr. Product Manager I (6841)Recently posted Auto Apply
MetroStar · Reston · Hybrid · Posted 18 Nov 2026 🇺🇸
AgileOperations & Project Management$166k - $189k/yr - ME

Sr. Product Manager I (6841)Recently posted Auto Apply
MetroStar · Herndon · Hybrid · Posted 18 Nov 2026 🇺🇸
AgileOperations & Project Management$166k - $189k/yr - PR

Technical Product Owner – Salesforce Health Cloud & AI-Enabled Agile DeliveryRecently posted Auto Apply
PRO-spectus · US - Remote · Remote · Posted 18 Nov 2026 🇺🇸
ScrumConfluenceHIPAA+3Technology$115k - $140k/yr - C2
Senior Product Manager, AI Experimentation Platform Auto Apply
Cscgeneration 2 · Cottonwood Heights · Hybrid · Posted 22 Oct 2026 🇺🇸
Operations & Project ManagementSalary not listed
