Quick overview
Job description
About the Role
We are seeking a Staff ML/AI Engineer to define and drive the architectural vision for Lyra’s machine learning and generative AI technology landscape. In this role, you will serve as a technical anchor across the engineering and data organizations—architecting enterprise-scale AI platforms, setting technical strategy for high-impact AI/ML initiatives, and ensuring our AI products operate with top-tier reliability, security, and medical precision.
The ideal candidate is a seasoned technical leader who excels at translating complex healthcare challenges into scalable platform solutions, building consensus across cross-functional leadership, and elevating the technical bar for the entire engineering organization.
Lyra is for you if you
-
Thrive on working with brilliant teammates to solve complex, meaningful problems
-
Are passionate about making a social impact and supporting people at their most challenging moments
-
Enjoy cross-functional collaboration with physicians, therapists, data scientists, data analysts and product managers
Responsibilities
-
Drive AI Platform Architecture: Design and execute the long-term roadmap for Lyra’s machine learning and generative AI platform, enabling fast, safe, and reliable deployment of frontier models across the company.
-
Lead AI Infrastructure Vision: Architect end-to-end training, fine-tuning, and low-latency inference platforms, including centralized RAG architecture, vector databases, and enterprise evaluation/guardrail frameworks.
-
Set Engineering Excellence Standards: Establish organizational standards for the full AI/ML SDLC—from dataset lineage and CI/CD pipelines to automated model evaluation, red-teaming, and production monitoring.
-
Cross-Functional Technical Leadership: Partner closely with Product Management, Data Science, Security, and Clinical leaders to translate strategic clinical goals into foundational AI capability roadmaps.
-
Mentor and Multiply Impact: Elevate the engineering culture by mentoring Senior ML Engineers, conducting high-leverage architectural reviews, and establishing engineering best practices across teams.
-
Hands-On Leadership: Lead by example through technical prototypes, critical-path architecture, and strategic coding contributions.
-
And of course, you will be coding!
Qualifications
-
8+ years of experience deploying complex ML/AI solutions into mission-critical production environments, with a proven track record of technical leadership.
-
Deep System & Software Engineering Expertise: Mastery of Python, RESTful API design, Protobuf, and microservices architecture.
-
Production AI/ML Infrastructure Mastery: Deep expertise with Docker, Kubernetes, container orchestration, and real-time inference services.
-
Modern Generative AI Architecture: Hands-on experience designing and deploying RAG pipelines, fine-tuning LLMs, managing vector databases, and building robust LLM evaluation/guardrail frameworks.
-
Data Layer Systems: Expertise with relational databases, low-latency key-value stores, distributed queueing system architectures (e.g., Celery, Kafka), and data pipeline orchestration.
-
Cloud Architecture: Strong experience architecting cloud-native solutions on AWS (or equivalent cloud providers).
-
Strategic Communication: Exceptional ability to distill highly ambiguous technical problems into clear strategic priorities and influence leadership across engineering, product, and business domain disciplines.
Preferred Qualifications
-
Polyglot Engineering Background: Experience writing high-performance production code in Java or Kotlin.
-
Healthcare & Sensitive Data Expertise: Experience architecting AI/ML systems within highly regulated environments (HIPAA compliance, SOC2, handling PHI/PII).
-
MLOps / Platform Productization: Experience building internal developer platforms or ML tooling used by dozens of data scientists and engineers.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- TT
Member of Technical Staff, Applied MLRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 14 Nov 2026 🇺🇸
Continuous ImprovementLLMPython+1$175k - $350k/yr - TO
Staff Machine Learning Engineer - Vision AIRecently posted Auto Apply
Toast · Remote · Remote · Posted 14 Nov 2026 🇺🇸
ScalaDiversity & InclusionJava+5Technology$151k - $309k/yr - TO
Principal Machine Learning Engineer, Vision AIRecently posted Auto Apply
Toast · Remote · Remote · Posted 14 Nov 2026 🇺🇸
AWSComputer VisionDiversity & Inclusion+7Technology$180k - $368k/yr - AR

Machine Learning EngineerRecently posted Auto Apply
Arena · SF Bay Area · Hybrid · Posted 14 Nov 2026 🇺🇸
Deep LearningLLMMachine Learning+1TechnologySalary not listed - CL

Machine Learning EngineerRecently posted Auto Apply
Claylabs · San Francisco · Hybrid · Posted 14 Nov 2026 🇺🇸
SnowflakeLLMdbt+3TechnologySalary not listed - TE

ML Engineer, Developer EcosystemRecently posted Auto Apply
Tensorwave · Remote · Remote · Posted 13 Nov 2026 🇺🇸
Background ChecksCUDAData Privacy+5TechnologySalary not listed - TE

ML Performance EngineerRecently posted Auto Apply
Tensorwave · Las Vegas · On-site · Posted 13 Nov 2026 🇺🇸
MLOpsBackground ChecksData Privacy+4Salary not listed - TT
Founding ML Research EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 14 Nov 2026 🇺🇸
Computer VisionHugging FacePyTorch+1$180k - $230k/yr - TT
Member of Technical Staff, Reinforcement LearningRecently posted Auto Apply
True Talent Solutions Partners · Remote · Remote · Posted 13 Nov 2026 🇺🇸
LLMPyTorchPython+1$250k - $400k/yr - TT
Member of Technical Staff, ML SystemsRecently posted Auto Apply
True Talent Solutions Partners · Menlo Park · On-site · Posted 13 Nov 2026 🇺🇸
CUDADeep LearningMachine Learning$180k - $260k/yr - SE
Senior Machine Learning EngineerRecently posted Auto Apply
ServiceNow · Santa Clara, California · Hybrid · Posted 13 Nov 2026 🇺🇸
Generative AITechnology$161.3k - $274.2k/yr - VT

Machine Learning EngineerRecently posted Auto Apply
Voyager Technologies, Inc. · El Segundo · Hybrid · Posted 13 Nov 2026 🇺🇸
MATLABComputer VisionDeep Learning+3Technology$120k - $280k/yr
