Quick overview
Job description
About the Role
Join a small, highly technical team building AI infrastructure that helps enterprise agents improve through production feedback. This backend-leaning full-stack role offers ownership of core systems and the product features that make them useful to customers.
What You'll Do
Build backend systems for agent evaluation and continuous improvement.
Design and evolve data models for evaluation datasets, experiment runs, agent traces, knowledge versions, findings, and customer-defined quality criteria.
Own enterprise integrations from authentication and data synchronization through retries, monitoring, and production support.
Take features from technical design and implementation through deployment, monitoring, customer feedback, and iteration.
Work with customers to diagnose issues and turn their needs into reusable product capabilities.
What We're Looking For
Three to six years of software engineering experience, with substantial backend-leaning full-stack experience and a strong individual-contributor focus.
Experience building production systems for enterprise customers, including data models, pipelines or queues, and integrations.
Comfort shipping user-facing features with TypeScript and React, alongside backend work in Python and relational or vector databases.
Experience at both a larger organization and an early-stage startup, with meaningful ownership in a small team.
A bachelor's degree in computer science or a related field.
AI, agent evaluation, or LLM experience is helpful, as is a founder background or participation in hackathons.
Compensation & Benefits
Base salary: $180,000 to $200,000 annually. Visa sponsorship is available.
Location
On-site in San Francisco, California, United States.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works