Quick overview
Job description
About the Role
Join a small, technical team building infrastructure for evaluating and continually improving enterprise AI agents. This backend-leaning full-stack role combines ownership of core systems with shipping the product features that make them useful to customers.
What You'll Do
Build backend systems for agent evaluation and continuous improvement.
Improve data models for evaluation datasets, experiment runs, agent traces, knowledge versions, findings, and customer-defined quality criteria.
Own enterprise integrations across authentication, OAuth, webhooks, data synchronization, backfills, rate limits, schema changes, retries, monitoring, and production support.
Take features from design and implementation through deployment, monitoring, customer feedback, and iteration.
Work with customers to diagnose issues and turn their needs into reusable product capabilities.
What We're Looking For
Three to six years of experience as a backend-leaning full-stack software engineer, with substantial software engineering experience.
Experience at both a large company and an early-stage startup, with meaningful individual-contributor ownership.
Experience building production systems for enterprise customers, including data models, pipelines or queues, or integrations.
Comfort shipping user-facing features with TypeScript and React; Python experience is preferred.
Familiarity with relational databases, vector databases, and cloud environments.
A bachelor's degree in computer science or a related field.
Background in AI agents, LLMs, or evaluation and quality systems is helpful.
Compensation & Benefits
Base salary is $180,000 to $200,000 annually. Visa sponsorship is available.
Location
On-site in San Francisco, California, United States.
Similar jobs
- DS

Senior Forward Deployed Engineer (Full-Stack)Recently posted Auto Apply
Dscout · Remote - US · Remote 🇺🇸
ElixirSwiftSOC 2+4EngineeringSalary not listed - TT
Fullstack EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site 🇺🇸
OnboardingFirebaseMongoDB+6TechnologySalary not listed - TT
Full Stack Software EngineerRecently posted Auto Apply
True Talent Solutions Partners · Remote · Remote 🇺🇸
CAD.NETReact+1TechnologySalary not listed - TT
Software Engineer, Full StackRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site 🇺🇸
ProcurementPythonSystem DesignTechnologySalary not listed - TT
Founding Full-Stack EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site 🇺🇸
Next.jsAWSNode.js+3TechnologySalary not listed - TT
Mid/Senior Full Stack AI EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site 🇺🇸
Next.jsERPCross-selling+5TechnologySalary not listed - RA

Full-Stack Engineer (Experienced) Auto Apply
Ranger · San Francisco · Hybrid 🇺🇸
PlaywrightGenerative AITechnology$130k - $200k/yr - RA

Full-Stack Engineer (Experienced) Auto Apply
Ranger · Denver · Hybrid 🇺🇸
PlaywrightGenerative AITechnology$130k - $200k/yr - TO

Full Stack AI Engineer (Healthcare Navigation)Recently posted Auto Apply
TouchCare · Stamford · Hybrid 🇺🇸
GCPGitSOC 2+16TechnologySalary not listed - SU

Senior Software Engineer, Full Stack Auto Apply
Sunbound · New York · Hybrid 🇺🇸
FlaskSpringNursing+3TechnologySalary not listed - SP
Mid Full Stack Engineer (5000) (Secret) (Broomfield, CO)Recently posted Auto Apply
Space Programs · Boulder · Hybrid 🇺🇸
GitComplianceC+++7TechnologySalary not listed - MC
Full Stack Software Engineer Graduate Co-op Auto Apply
MORSE Corp Co-op Opportunities · Cambridge · Hybrid 🇺🇸
DockerGitAWS+5TechnologySalary not listed