Product Analyst III – Context Designer

Position: Product Analyst III – Context Designer

Duration: 6+ Months Contract (Extendable/Can be converted in Perm)

Location: Remote

 

Job Description:

We are seeking a highly analytical and detail-oriented Product Analyst to act as a "Context Designer" for Client's voice AI and prompt-driven initiatives. While this is a non-engineering role, it requires a strong technical bent. You will focus on driving use case context development by drafting natural language prompts, configuring conversational flows, and refining business requirements across CDL/Sales, Servicing, and Production/MFD.

 

Key Responsibilities:

• Prompt & Flow Design: Act as a "Context Designer" to write, refine, and configure natural language prompts and conversational flows based on defined business logic.
• Requirements Gathering: Collaborate daily with sales, servicing, and fulfillment teams to capture, define, and negotiate business requirements for AI agent interactions.
• Knowledge Base Curation: Review and curate operational PDFs and documentation to provide a verified "Source of Truth" for the RAG Vector Database.
• A/B Testing & Analysis: Execute A/B tests on various prompt configurations and analyze the resulting data to improve accuracy, tone, and resolution rates.
• Evaluation Support: Assist the Product Owner in defining and documenting the "Golden Dataset" of test scenarios to support automated AI evaluations.
• Technical Collaboration: Work alongside platform engineers who manage the underlying technical architecture within the AWS tech stack to ensure successful API handshakes and platform functionality.

 

Qualifications:

• 3–5 years of experience as a Product Analyst, Business Analyst, or similar role (targeting Analyst III level).
• A non-engineer with a strong "technical bent" and the ability to quickly grasp Generative AI concepts (e.g., RAG, LLM orchestration, prompt tuning).

• Solid Financial Services and mortgage industry experience strongly preferred

 

Client Notes:

The Product Analyst will support the development of an AI-powered voice bot. The role bridges business and engineering by gathering requirements, creating prototypes, defining product roadmaps, and ensuring the AI experience aligns with customer needs before handing work off to the engineering team.

 

Key Responsibilities

• Partner with business stakeholders to understand current processes and identify improvement opportunities.
• Gather and document business and product requirements.
• Create initial prototypes and product designs before transitioning work to engineering.
• Help define and maintain the product roadmap.
• Analyze and improve the balance between human interactions and AI-driven experiences.
• Manage product backlog and prioritize features.
• Work on customer-facing conversational AI experiences.

 

Ideal Candidate Profile

• Strong Product Analyst/Product Owner background with a technical mindset.
• Experience with Generative AI and conversational AI/voice bot products.
• Experience designing customer-facing AI experiences rather than internal data management tools.
• Comfortable working closely with both business stakeholders and engineering teams.
• Strong skills in prototyping, requirement gathering, backlog management, and roadmap planning.
• Mortgage industry experience is a plus (secondary preference).
• Overall, this is a semi-technical product role with a strong focus on AI product development.

 

Time Allocation

• 50% – Backlog management, product design, and requirement definition
• 30% – Product strategy and roadmap planning
• 20% – Stakeholder collaboration and people/team coordination

 

Top Priorities

• Technical product management experience.
• Generative AI and conversational AI/voice bot experience.
• Customer-facing product development.
• Strong stakeholder management and requirement gathering.
• Ability to prototype ideas and collaborate effectively with engineering.