Back to Jobs
Full timeTechnology
OU

Backend / ML-Ops Engineer — Speech Model Deployment & Inference Optimization
Quick overview
SeniorityMid Senior
Employment typeFull Time
Work modeOn Site
LocationBengaluru, India
DockerGCPAWSELKMLflowSOC 2BashGrafanaHIPAALLMPrometheusPythonAzureKubernetesCI/CD
Job description
OutcomesAI is a healthcare technology company building an AI-enabled nursing platform designed to augment clinical teams, automate routine workflows, and safely scale nursing capacity.
Our solution combines AI voice agents and licensed nurses to handle patient communication, symptom triage, remote monitoring, and post-acute care — reducing administrative burden and enabling clinicians to focus on direct patient care.
Our core product suite includes:
● Glia Voice Agents – multimodal conversational agents capable of answering patient calls, triaging symptoms using evidence-based protocols (e.g., Schmitt-Thompson), scheduling visits, and delivering education and follow-ups.
● Glia Productivity Agents – AI copilots for nurses that automate charting, scribing, and clinical decision support by integrating directly into EHR systems such as Epic and Athena.
● AI-Enabled Nursing Services – a hybrid care delivery model where AI and licensed nurses work together to deliver virtual triage, remote patient monitoring, and specialty patient support programs (e.g., oncology, dementia, dialysis).
Our AI infrastructure leverages multimodal foundation models — incorporating speech recognition (ASR), natural language understanding, and text-to-speech (TTS) — fine-tuned for healthcare environments to ensure safety, empathy, and clinical accuracy. All models operate within a HIPAA-compliant and SOC 2–certified framework. OutcomesAI partners with leading health systems and virtual care organizations to deploy and validate these capabilities at scale. Our goal is to create the world’s first AI + nurse hybrid workforce, improving access, safety, and efficiency across the continuum of care.
Own the infrastructure and pipelines for integrating trained ASR/TTS/Speech-LLM models into production. Focus on scalable serving, GPU optimization, monitoring, and continuous improvement of inference latency and reliability.
What You’ll Do
- Containerize and deploy speech models using Triton Inference Server with TensorRT/FP16 optimizations.
- Develop and manage CI/CD pipelines for model promotion (staging → production).
- Configure autoscaling on Kubernetes (GPU pools) based on active calls or streaming sessions.
- Build health and observability dashboards: latency, token delay, WER drift, SNR/packet loss monitors.
- Integrate LM bias APIs, failover logic, and model switchers for fallback to larger/cloud models.
- Implement on-device or edge inference paths for low-latency scenarios.
- Collaborate with AI team to expose APIs for context biasing, rescoring, and diagnostics.
- Optimize GPU/CPU utilization, cost optimization, and memory footprint for concurrent ASR/TTS/Speech LLM workloads.
- Maintain data and model versioning pipelines with MLflow, DVC, or internal registries.
Desired Skills
- Experience with Triton, TensorRT, Docker, Kubernetes, and GPU scheduling.
- Familiarity with speech inference (streaming ASR, TTS pipelines).
- Proficient in Python, Bash, and cloud services (AWS/GCP/Azure).
- Understanding of observability stacks (Prometheus, Grafana, ELK).
- Knowledge of DevSecOps, access policies, and PHI-safe environments.
- Interest in inference optimization, mixed precision, and quantization.
Qualifications
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- CA

Java Backend Developer with Kubernetes - VadodaraRecently posted Auto Apply
Capco · Pune · Hybrid · Posted 18 Nov 2026 🇮🇳
DockerMicroservicesSQL+15TechnologySalary not listed - CA

Java Backend Developer with Kubernetes - VadodaraRecently posted Auto Apply
Capco · Pune · Hybrid · Posted 18 Nov 2026 🇮🇳
DockerMicroservicesSpring+14TechnologySalary not listed - AD

Backend Engineer (Java)Recently posted Auto Apply
Adyen · Bengaluru · Hybrid · Posted 17 Nov 2026 🇮🇳
SQLJavaREST+1TechnologySalary not listed - OI

Senior Java DevRecently posted Auto Apply
Orion Innovation · Pune · Hybrid · Posted 18 Nov 2026 🇮🇳
MicroservicesSpringSpring Boot+10Salary not listed - BI

Backend Engineer E2 - EcosystemRecently posted Auto Apply
BitGo · India · Hybrid · Posted 16 Nov 2026 🇮🇳
MicroservicesMongoDBGit+7TechnologySalary not listed - AC

Senior AI Engineer – Backend Engineering (Agentic AI) Auto Apply
Acceldata · Bengaluru · On-site 🇮🇳
WorkdayDockerMicroservices+15TechnologySalary not listed - AG

Backend Engineer Manager (Gurugram based)Recently posted Auto Apply
Agoda · Gurugram · Hybrid · Posted 16 Nov 2026 🇮🇳
ScalaC#Java+3TechnologySalary not listed - CA

Java Backend Developer - Vadodara/ PuneRecently posted Auto Apply
Capco · Pune · Hybrid · Posted 15 Nov 2026 🇮🇳
MicroservicesSpringSpring Boot+2TechnologySalary not listed - WE

Senior Backend Engineer - India (Golang + Distributed Systems)Recently posted Auto Apply
Weave · India · Remote · Posted 13 Nov 2026 🇮🇳
DockerGCPMicroservices+10TechnologySalary not listed - SU

Senior Software Engineer II - Backend DevelopmentRecently posted Auto Apply
Surveymonkey · Bengaluru · Hybrid · Posted 13 Nov 2026 🇮🇳
RecruitingSourcingFastAPI+17TechnologySalary not listed - RE
Software Development Engineer -Backend(Node Js)Recently posted Auto Apply
Renesas Electronics · Bangalore · On-site · Posted 13 Nov 2026 🇮🇳
AltiumAgileTechnologySalary not listed - CO

Principal Engineer- BackendRecently posted Auto Apply
Coderabbit · Bengaluru · Hybrid · Posted 12 Nov 2026 🇮🇳
GitDiversity & InclusionTriage+1TechnologySalary not listed