Quick overview
Job description
About the Role
Join an early-stage AI company building infrastructure that helps enterprise agents improve through production feedback. This backend-leaning full-stack role will shape the systems and product features that make agent workflows more reliable.
What You'll Do
Build backend systems for agent evaluation and continuous improvement.
Develop data models for evaluation datasets, experiment runs, agent traces, knowledge versions, findings, and customer-defined quality criteria.
Own enterprise integrations, including authentication, OAuth, webhooks, data syncs, backfills, rate limits, retries, monitoring, and production support.
Take features from technical design through implementation, deployment, monitoring, customer feedback, and iteration.
Work with customers to diagnose system issues and turn their needs into reusable product capabilities.
What We're Looking For
Three to six years of experience as a backend-leaning full-stack software engineer, with substantial software engineering experience.
Experience at both a large company and an early-stage startup, with meaningful individual-contributor ownership.
Experience building production systems for enterprise customers, including data models, pipelines or queues, and integrations.
Comfort shipping user-facing features with TypeScript and React; Python experience is preferred.
Knowledge of relational databases, vector databases, and cloud environments.
A bachelor's degree in computer science or a related field.
Experience with agents, LLMs, evaluation, or QA is beneficial.
Compensation & Benefits
Base salary: $180,000 to $200,000 annually. Visa sponsorship is available.
Location
On-site in San Francisco, California, United States.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works