Haystack
← Back to Jobs
Operations & Project Management
AI

Product Owner (AI, LLM & RAG)

ARK Infotech SpectrumCharlotte, NC🇺🇸United StatesPosted 10 Sept 2026

Why This Role Stands Out

This role offers a unique opportunity to shape the future of AI products, driving innovation in LLM and RAG technologies. You'll thrive here if you are a strategic thinker with a passion for translating complex AI concepts into tangible business value, and we encourage you to apply.

Quick Overview

Seniority
Mid Senior
Work mode
On Site
Location
Charlotte, NC, United States
Posted
Yesterday
SAFeScrumAgile

Job Description

Role: Product Owner (AI, LLM & RAG)

Location: Charlotte, NC or Bay Area, CA (Onsite) - Locals

 

Role Summary
The Product Owner will partner with business and technology teams to take AI and agentic use cases from initial problem framing through production release and adoption. The role owns use-case intake, prioritization, backlog management, acceptance criteria, evaluation KPIs, governance readiness, and measurable business outcomes.

 

Key Responsibilities
Facilitate business problem framing and identify suitable AI, LLM, RAG, or agentic solution patterns.
Manage use-case intake, prioritization, feasibility assessment, and roadmap alignment.
Create product epics, user stories, acceptance criteria, and release objectives.
Coordinate data, model, platform, security, risk, and engineering stakeholders.
Define business, model-quality, operational, adoption, and value-realization KPIs.
Support model selection, prompt strategy, RAG design, evaluations, and human-in-the-loop controls.
Ensure responsible AI, security, compliance, and model-risk requirements are addressed.
Drive user acceptance, release readiness, adoption planning, and post-release outcome tracking.

 

Required Skills
Product management and Agile backlog ownership.
Business problem framing and use-case prioritization.
Understanding of LLMs, RAG, agentic AI, model selection, and evaluation approaches.
Experience defining functional and non-functional acceptance criteria.
Responsible AI, model-risk, security, and governance controls.
Product analytics, adoption metrics, and business-value measurement.
Executive communication and stakeholder facilitation.
Experience working with multidisciplinary AI engineering teams.

Preferred Qualifications
Bachelor’s or master’s degree in technology, business, data science, or a related field.
Product Owner, Scrum, SAFe, or product-management certification.
Experience delivering enterprise AI solutions in a regulated environment.
Must be located in Charlotte, NC or in the California Bay Area

Similar jobs