Quick overview
Job description
About UpDoc
At UpDoc, we are building the first clinically validated, physician-supervised AI agent that manages chronic diseases. We are an early-stage startup founded by Stanford physicians.
We are seeking a talented and motivated senior engineer to join our team. You will primarily work on UpDoc’s patient-facing conversational agent. This is a fully remote position.
Who You Are
You’re an experienced senior engineer with a backend tilt. You’re well-versed in all things web and have experience building LLM applications end-to-end, even if not in a professional context. You follow the AI/LLM space closely, play with new technologies as they come out, and are excited to use these technologies to build safe, reliable medical AI systems.
What You'll Do
Lead the development of our patient-facing conversational agent
Implement a scalable, low-latency system for voice/multimodal conversations
Implement rigorous prompt engineering processes and develop useful metrics for system evaluation
Identify where fine-tuning and alignment might be valuable, and create data pipelines to enable fast experimentation
Work with other backend engineers to deploy AI models and chat/voice APIs
Help identify, evaluate, and implement emerging LLM technologies, tools and frameworks
Collaborate with clinical experts to validate performance and medical accuracy
Work on developing backend services using FastAPI and Pydantic
What You’ll Need
5+ years of professional software development experience, including 2+ years of experience with backend web development
Experienced and comfortable working with type-hinted, modern Python
2+ years of experience building end-to-end LLM applications, personally or professionally
Experience integrating/optimizing LLMs in production environments
Knowledge of evaluation frameworks
Knowledge and experience with MLOps/LLMOps best practices
Experience building AI infrastructure from 0 -> 1
Experience with cloud platforms (especially Azure) and containerization technologies
Highly Desired
Professional experience building end-to-end LLM-powered applications
Experience with model fine-tuning/alignment
Experience in an early stage startup environment
Experience with healthcare industry standards, such as FHIR, and regulations, including HIPAA and SOC 2
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- AR

Software Engineer, Data Infrastructure and Performance MetricsRecently posted Auto Apply
Artafinance · Bay Area · Hybrid · Posted 18 Nov 2026 🇺🇸
System DesignTechnology$110k - $300k/yr - TT
Senior Software Engineer, Customer Studio BackendRecently posted Auto Apply
True Talent Solutions Partners · Remote · Remote · Posted 18 Nov 2026 🇺🇸
Generative AITechnology$180k - $320k/yr - TT
Senior Forward Deployed Engineer, OperateRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 18 Nov 2026 🇺🇸
GCPNext.jsAWS+13Engineering$170k - $205k/yr - TT
Founding Product EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 18 Nov 2026 🇺🇸
Next.jsHTMLFigma+5$160k - $220k/yr - TT
Senior/Staff Software Engineer, PlatformRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 18 Nov 2026 🇺🇸
AWSCRMERP+5Technology$180k - $270k/yr - TT
Software Engineer, C++ SystemsRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 18 Nov 2026 🇺🇸
RustC++Kubernetes+1Technology$250k - $325k/yr - TT
Founding Software EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 18 Nov 2026 🇺🇸
LLMPythonReact+1Technology$200k - $250k/yr - TT
Senior Software Engineer, DesignRecently posted Auto Apply
True Talent Solutions Partners · Remote · Remote · Posted 18 Nov 2026 🇺🇸
FigmaCSSTailwind CSS+2Technology$150k - $350k/yr - TT
Software Engineer, AI AgentsRecently posted Auto Apply
True Talent Solutions Partners · Remote · Remote · Posted 18 Nov 2026 🇺🇸
LLMMachine LearningTechnology$200k - $320k/yr - TT
Product EngineerRecently posted Auto Apply
True Talent Solutions Partners · Palo Alto · On-site · Posted 18 Nov 2026 🇺🇸
SQLAmplitudeMixpanel+4$185k - $205k/yr - TT
Software Engineer, iOSRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 18 Nov 2026 🇺🇸
SwiftiOSRESTTechnology$130k - $230k/yr - TT
Principal Software Engineer, PerceptionRecently posted Auto Apply
True Talent Solutions Partners · Alameda · On-site · Posted 18 Nov 2026 🇺🇸
Edge ComputingRoboticsComputer Vision+3Technology$300k - $380k/yr