Quick overview
Job description
About Sage Care
Sage Care is a fast-growing, early-stage healthcare startup founded by exceptional leaders from Apple, Uber, Carbon Health and backed by top-tier venture capital (General Catalyst, Chelsea Clinton). With a strong customer pipeline, Sage Care is transforming healthcare by simplifying care navigation.
Our platform makes it easier for patients to find the right doctor and helps providers focus on those who need them most through harnessing the latest AI innovations.
Building on our successful collaborations with health systems across the U.S., we have expanded internationally to the MENA region. We are now partnering with health systems there to deploy our AI-powered care navigation platform.
About the Role
We’re hiring a Software Engineer to build the evaluations platform behind our AI agents. You’ll define how we measure quality, build the systems that make those measurements trustworthy, and turn production failures into improvements.
You’ll work closely with engineering, research, product, and clinical stakeholders. We welcome senior and staff-level engineers; scope will reflect your experience. Healthcare experience is optional.
What You’ll Do
Define metrics and curate datasets that capture quality, task completion, and safety across patient workflows.
Build the evaluation platform, harnesses, and grading infrastructure to measure agent performance at scale.
Develop verifiers and LLM-based evaluators for agent actions and outputs, calibrated against expert assessments.
Analyze production conversations and execution traces, and turn failure modes into regression tests.
Own the feedback loop from evaluation results to model, prompt, and product improvements.
Establish evaluation gates that guide whether agent changes ship.
Build reusable tools that let engineers and domain experts contribute evaluations and act on results.
What We’re Looking For
Required
5+ years of software or ML engineering experience shipping production systems.
You’ve built evaluation platforms or frameworks that other engineers depend on.
You can design datasets, metrics, and evaluators—and explain why their results are trustworthy.
Strong backend engineering skills and the ability to own ambiguous problems end to end.
Nice to Have
Experience with voice AI, agent simulation, or post-training.
Healthcare experience.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- CL

Member of Technical Staff, AgentsRecently posted Auto Apply
Clera · Palo Alto · Remote · Posted 15 Nov 2026 🇺🇸
DjangoSQLPython+3$200k - $300k/yr - CL

Senior Member of Technical StaffRecently posted Auto Apply
Clera · San Francisco · On-site · Posted 15 Nov 2026 🇺🇸
PythonReactJavaScript+2$150k - $215k/yr - CL

Forward Deployed EngineerRecently posted Auto Apply
Clera · New York · Remote · Posted 15 Nov 2026 🇺🇸
SQLETLLLM+3EngineeringSalary not listed - CL

Senior Agent EngineerRecently posted Auto Apply
Clera · Palo Alto · Remote · Posted 15 Nov 2026 🇺🇸
DjangoPythonReact+2EngineeringSalary not listed - TE

Software Developer, CarrierRecently posted Auto Apply
TextNow, Inc. · San Francisco · Hybrid · Posted 13 Nov 2026 🇺🇸
RecruitingMicroservicesPHP+8Technology$136.3k - $273.9k/yr - NE
Software Engineer, ProductRecently posted Auto Apply
Netic · San Francisco · On-site · Posted 15 Nov 2026 🇺🇸
DatabricksLLMPython+3TechnologySalary not listed - NE
Software Engineer, InfrastructureRecently posted Auto Apply
Netic · San Francisco · On-site · Posted 15 Nov 2026 🇺🇸
GCPGitAWS+9TechnologySalary not listed - CO
Application Developer Auto Apply
City of New York · New York City, NY · On-site 🇺🇸
OracleSQLActive Directory+7TechnologySalary not listed - MI

Software Engineer, 3D RenderingRecently posted Auto Apply
Mirage · Union Square · Hybrid · Posted 14 Nov 2026 🇺🇸
RustLinearC+++2TechnologySalary not listed - MI

Software Engineer, iOSRecently posted Auto Apply
Mirage · Union Square · Hybrid · Posted 14 Nov 2026 🇺🇸
SwiftUIiOSTechnologySalary not listed - MI

Software Engineer, BackendRecently posted Auto Apply
Mirage · Union Square · Hybrid · Posted 14 Nov 2026 🇺🇸
Generative AIMachine LearningTechnologySalary not listed - MI

Software Engineer, AgentsRecently posted Auto Apply
Mirage · Union Square · Hybrid · Posted 14 Nov 2026 🇺🇸
RAGTechnologySalary not listed