Quick overview
Job description
About the Role
Build the applied AI systems layer for a B2B process intelligence product. You will turn complex enterprise data into reliable, structured insights using hosted foundation models, working across retrieval, evaluation, orchestration, and production quality.
What You'll Do
Build and maintain AI services that transform raw enterprise data into useful product outputs.
Develop retrieval, context construction, structured extraction, and multi-step workflows using hosted language model APIs.
Create evaluation datasets, benchmarks, regression tests, and launch criteria to measure and improve model behavior.
Monitor production systems, investigate customer-facing incidents, and improve reliability, latency, cost, and recovery paths.
Design guardrails, verification steps, and fallbacks to reduce errors and make AI behavior safer and more predictable.
Use customer feedback and product outcomes to guide experiments, implementation decisions, and ongoing improvements.
What We're Looking For
Typically 5 to 10 years of experience building production software, applied AI, or ML products.
Strong Python skills, including building services and working with asynchronous patterns; familiarity with Go or another typed language is helpful.
Hands-on experience bringing hosted LLM APIs into customer-facing products, including structured outputs, retrieval, tool use, or agentic workflows.
Experience owning AI product features through deployment and monitoring, and handling production incidents and debugging.
Practical knowledge of AI evaluation, benchmarks, CI/CD, guardrails, and regression testing.
Experience with retrieval systems, embeddings, search, ranking, or extracting information from complex documents is valuable.
Systems thinking, clear communication, and the ability to iterate with customers in a changing product environment.
A bachelor's degree or higher in computer science, engineering, or a related technical field.
Familiarity with technologies such as PostgreSQL, Redis, React, TypeScript, GCP, Terraform, Docker, and vector databases is useful.
Compensation & Benefits
Base salary range: $180,000 to $275,000 annually. Visa sponsorship is available.
Location
On-site in San Francisco, California.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- RG
Machine Learning EngineerRecently posted Auto Apply
RZR Global Inc. · San Francisco · Hybrid · Posted 17 Nov 2026 🇺🇸
RustSQLFlink+10TechnologySalary not listed - SI

Principal AI/ML Engineer - VC Backed StartupsRecently posted Auto Apply
Signalfire · Remote - No Preference · Remote · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDockerGCP+23TechnologySalary not listed - SI

Principal AI/ML Engineer - VC Backed StartupsRecently posted Auto Apply
Signalfire · NYC - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDockerGCP+23TechnologySalary not listed - SI

Principal AI/ML Engineer - VC Backed StartupsRecently posted Auto Apply
Signalfire · Bay Area - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDockerGCP+23TechnologySalary not listed - SI

Head of AI/ML (Director/VP) - VC Backed StartupsRecently posted Auto Apply
Signalfire · Remote - No Preference · Remote · Posted 17 Nov 2026 🇺🇸
RecruitingTalent AcquisitionWorkforce Planning+22TechnologySalary not listed - SI

Head of AI/ML (Director/VP) - VC Backed StartupsRecently posted Auto Apply
Signalfire · NYC - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
RecruitingTalent AcquisitionWorkforce Planning+22TechnologySalary not listed - SI

Head of AI/ML (Director/VP) - VC Backed StartupsRecently posted Auto Apply
Signalfire · Bay Area - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
RecruitingTalent AcquisitionWorkforce Planning+22TechnologySalary not listed - PH

ML Infra Engineer, ComputeRecently posted Auto Apply
Physicalintelligence · San Francisco · On-site · Posted 16 Nov 2026 🇺🇸
GCPCapacity PlanningPyTorch+4Salary not listed - TR
Automated Driving Advanced Development Intern, Machine Learning Research Auto Apply
Tri · Los Altos · Hybrid · Posted 9 Nov 2026 🇺🇸
RoboticsAutonomous DrivingPyTorch+3Technology$65/hr - TT
Member of Technical Staff, Applied MLRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 17 Nov 2026 🇺🇸
Continuous ImprovementLLMPython+1$175k - $350k/yr - TT
Member of Technical Staff, ML SystemsRecently posted Auto Apply
True Talent Solutions Partners · Menlo Park · On-site · Posted 17 Nov 2026 🇺🇸
CUDADeep LearningLLM+2$180k - $260k/yr - TT
Senior Data & Machine Learning EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York City · On-site · Posted 16 Nov 2026 🇺🇸
SQLETLdbt+1Technology$200k - $300k/yr