Quick overview
Job description
Who is Authenticx?
Authenticx is on a mission to help humans understand humans. Our software platform is the new standard for humanizing customer interaction data at scale. We do this by channeling our passion and talent into helping health care leaders listen to their conversational data in a way that delivers value to the enterprise.
What do we offer our team members?
- A culture based on our core values of Authenticity, Courage and Having Fun
- A collaborative environment that supports your personal and professional development
- Hybrid working flexibility
- Free health insurance options
- Comprehensive benefits - medical, vision, dental, life, and disability insurance
- HSA and FSA plans
- 401(K)
- Unlimited vacation time
- Generous paid holidays, sick leave, and parental leave
- Perks at Work membership for discounts on shopping, travel and much more
Position Summary
The AI Prompt Engineer will lead the design, development, and optimization of large language model (LLM) prompts used for scalable conversation scoring at Authenticx. This role is critical in translating objective scoring rubrics into reusable, testable prompt logic that supports our enterprise healthcare clients. The engineer will collaborate across teams including engineering, implementation, product, and data labeling to deliver reliable and high-quality prompt workflows. This is a hands-on role suited for someone who thrives in an experimental, iterative environment and has an interest in scaling natural language solutions.
Key Responsibilities
- Design and implement sophisticated LLM prompts aligned to internal scoring rubrics and customer-specific needs.
- Conduct prompt testing and evaluation using labeled datasets to ensure performance accuracy.
- Collaborate with engineering to improve tooling and infrastructure for managing LLM scoring workflows.
- Maintain a centralized prompt library to ensure reuse and standardization across use cases.
- Document prompt strategies, testing approaches, and outcomes for internal learning.
- Identify and resolve inefficiencies in the prompt development and deployment process.
- Partner with product and data labeling teams to improve the quality and consistency of scoring outputs.
Required Qualifications
- Strong understanding of LLMs, NLP systems, and prompt engineering concepts.
- Ability to structure and document complex logic in a scalable and repeatable manner.
- Demonstrated ability to collaborate effectively with both technical and non-technical teams.
- Analytical mindset with an interest in experimentation, iteration, and data-driven decision-making.
Preferred Qualifications
- Experience in structured data labeling or QA workflows.
- Familiarity with tools like LangChain, OpenAI/GPT APIs, or vector databases.
- Background in linguistics, cognitive science, or HCI.
- Proficiency in Python or scripting tools for evaluation or automation.
Additional Information
- May include occasional travel for team meetings or planning sessions
- Must be authorized to work in the U.S. without current or future visa sponsorship.
- This role will be hybrid based out of our Indianapolis office,
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- TT
Founding AI EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 17 Nov 2026 🇺🇸
Next.jsPlaywrightNode.js+1Technology$216k - $250k/yr - BG
AI Application Intern (8 months/40 hours per week)Recently posted Auto Apply
Bosch Group · Farmington Hills, MI · On-site · Posted 17 Nov 2026 🇺🇸
Microsoft OfficeGenerative AIData Analysis+1EngineeringSalary not listed - QP
AI, Data & Automation EngineerRecently posted Auto Apply
Qualderm Partners · Brentwood, Tennessee · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLGitETL+12TechnologySalary not listed - OP

Applied AI Architect - EDURecently posted Auto Apply
Openai · San Francisco · Hybrid · Posted 17 Nov 2026 🇺🇸
LLMPythonGenerative AI+1TechnologySalary not listed - ME

Enterprise AI LeadRecently posted Auto Apply
Mercor · New York City · On-site · Posted 16 Nov 2026 🇺🇸
Enterprise SalesMental HealthSalary not listed - SI

Applied AI Scientist/Researcher (Senior/Staff) - VC Backed StartupsRecently posted Auto Apply
Signalfire · Remote - No Preference · Remote · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionScikit-learnSnowflake+11Salary not listed - SI

Applied AI Scientist/Researcher (Senior/Staff) - VC Backed StartupsRecently posted Auto Apply
Signalfire · NYC - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionScikit-learnSnowflake+11Salary not listed - SI

Applied AI Scientist/Researcher (Senior/Staff) - VC Backed StartupsRecently posted Auto Apply
Signalfire · Bay Area - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionScikit-learnSnowflake+11Salary not listed - SI

Founding AI Engineer (Senior/Staff) - VC Backed StartupsRecently posted Auto Apply
Signalfire · Remote - No Preference · Remote · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDockerFastAPI+23TechnologySalary not listed - SI

Founding AI Engineer (Senior/Staff) - VC Backed StartupsRecently posted Auto Apply
Signalfire · NYC - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDockerFastAPI+23TechnologySalary not listed - SI

Founding AI Engineer (Senior/Staff) - VC Backed StartupsRecently posted Auto Apply
Signalfire · Bay Area - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDockerFastAPI+23TechnologySalary not listed - PL

Senior AI EngineerRecently posted Auto Apply
Plaud · Palo Alto · Hybrid · Posted 16 Nov 2026 🇺🇸
SOC 2ComplianceCustomer Success+6Technology$159k - $239k/yr
