Quick overview
Job description
About the Role
Build the applied AI systems layer for a B2B process intelligence product. You will turn complex enterprise data into reliable, structured insights using hosted foundation models, working across retrieval, evaluation, orchestration, and production quality.
What You'll Do
Build and maintain AI services that transform raw enterprise data into useful product outputs.
Develop retrieval, context construction, structured extraction, and multi-step workflows using hosted language model APIs.
Create evaluation datasets, benchmarks, regression tests, and launch criteria to measure and improve model behavior.
Monitor production systems, investigate customer-facing incidents, and improve reliability, latency, cost, and recovery paths.
Design guardrails, verification steps, and fallbacks to reduce errors and make AI behavior safer and more predictable.
Use customer feedback and product outcomes to guide experiments, implementation decisions, and ongoing improvements.
What We're Looking For
Typically 5 to 10 years of experience building production software, applied AI, or ML products.
Strong Python skills, including building services and working with asynchronous patterns; familiarity with Go or another typed language is helpful.
Hands-on experience bringing hosted LLM APIs into customer-facing products, including structured outputs, retrieval, tool use, or agentic workflows.
Experience owning AI product features through deployment and monitoring, and handling production incidents and debugging.
Practical knowledge of AI evaluation, benchmarks, CI/CD, guardrails, and regression testing.
Experience with retrieval systems, embeddings, search, ranking, or extracting information from complex documents is valuable.
Systems thinking, clear communication, and the ability to iterate with customers in a changing product environment.
A bachelor's degree or higher in computer science, engineering, or a related technical field.
Familiarity with technologies such as PostgreSQL, Redis, React, TypeScript, GCP, Terraform, Docker, and vector databases is useful.
Compensation & Benefits
Base salary range: $180,000 to $275,000 annually. Visa sponsorship is available.
Location
On-site in San Francisco, California.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works