Quick overview
Job description
About the Role
Join a core product team building agentic systems that automate complex, multi-step workflows across regulated and enterprise domains. You will ship production LLM services and help ensure they are reliable, safe, and useful to customers.
What You'll Do
Design, build, and maintain agentic systems for workflows across healthcare, legal, fintech, logistics, and compliance.
Own retrieval-augmented generation pipelines and retrieval infrastructure, including vector databases, embeddings, and indexing.
Build multi-agent orchestration, tool-calling, memory, and reasoning components.
Develop evaluation and safety infrastructure to measure model performance, surface regressions, and support enterprise reliability.
Deliver full-stack AI products by designing APIs and data models, building frontend and backend features, and operating production systems with CI/CD, monitoring, and testing.
Work with product and design partners to prioritize features, define success metrics, and iterate using user feedback and telemetry.
What We're Looking For
Two to eight years of software engineering experience delivering shipped user-facing or backend products.
Production experience deploying LLM-based services, including prompt design, orchestration, and tool integration.
Full-stack proficiency with Python and TypeScript/React or equivalent, plus experience with AWS or GCP and relational or NoSQL databases.
Working knowledge of RAG, vector databases, embeddings, and retrieval pipelines.
Experience building automated tests, evaluations, and monitoring for production AI systems.
Experience designing API-driven, high-throughput systems and real-time product features.
Familiarity with agent or workflow frameworks and orchestration tools; experience with fine-tuning or multimodal models is also useful.
Background in multi-tenant or enterprise systems, or in regulated industries such as healthcare, fintech, or legal.
Ability to own features end to end, from data modeling through deployment and monitoring.
Compensation & Benefits
Base salary: $150,000 to $180,000 annually. Visa sponsorship is not available.
Location
On-site in San Francisco, California.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- CE

Staff Data EngineerRecently posted Auto Apply
Consumer Edge · United States · Hybrid · Posted 21 Nov 2026 🇺🇸
SQLSnowflakeAirflow+6Technology$175k - $210k/yr - HA

Creative AI EngineerRecently posted Auto Apply
Harvey · San Francisco · Hybrid · Posted 21 Nov 2026 🇺🇸
FigmaLLMTechnology$168.4k - $252.6k/yr - HA

Creative AI EngineerRecently posted Auto Apply
Harvey · New York · Hybrid · Posted 21 Nov 2026 🇺🇸
FigmaLLMTechnology$168.4k - $252.6k/yr - CL

Automation Engineer, Dealership IntegrationsRecently posted Auto Apply
Clera · San Francisco · On-site · Posted 21 Nov 2026 🇺🇸
ReconciliationTechnologySalary not listed - AL
Business Intelligence Director - AmericasRecently posted Auto Apply
AlixPartners · Boston +4 · Hybrid · Posted 21 Nov 2026 🇺🇸
Market ResearchContinuous ImprovementFinancial Analysis+5Technology$195k/yr - SE

Software Engineer, New GradRecently posted Auto Apply
Secureframe · New York · On-site · Posted 21 Nov 2026 🇺🇸
HTMLCSSCompliance+3Technology$100k - $120k/yr - MB
Business Intelligence (BI) AnalystRecently posted Auto Apply
Manhattan Beer & Beverage Distributors · Bronx · Hybrid · Posted 21 Nov 2026 🇺🇸
SQLTableauERP+6Technology$80k - $90k/yr - CA
Project Manager - Ubuntu Embedded SystemsRecently posted Auto Apply
Canonical_managed_posts · New York · Hybrid · Posted 20 Nov 2026 🇺🇸
Embedded SystemsIoTPMP+3TechnologySalary not listed - RE
Senior Security ConsultantRecently posted Auto Apply
Resultant · Indianapolis, IN · Remote · Posted 21 Nov 2026 🇺🇸
GCPAWSOWASP+6TechnologySalary not listed - CO
Issuer for the Emergency Operations and Enhanced Enforcement Division (EOD)Recently posted Auto Apply
City of New York · New York City, NY · On-site · Posted 21 Nov 2026 🇺🇸
Microsoft ExcelTechnologySalary not listed - CO
Senior Director, Solution ArchitectureRecently posted Auto Apply
City of New York · Brooklyn, NY · On-site · Posted 21 Nov 2026 🇺🇸
TechnologySalary not listed - CO
Chief, Project and Field ComplianceRecently posted Auto Apply
City of New York · Valhalla, NY · On-site · Posted 21 Nov 2026 🇺🇸
Microsoft ExcelMicrosoft OfficeProject Management+1TechnologySalary not listed