Quick Overview
Work Type
Hybrid
Level
Mid Senior
Job Description
Project description
Join Our Team: Innovating Health Care with Cutting-Edge Technology
Combine two of the fastest-growing fields on the planet with a culture of performance, collaboration, and opportunity - and this is what you get. We are at the forefront of technology in an industry that is transforming the lives of millions. Here, innovation isn't just about creating another gadget; it's about making health care data accessible whenever and wherever people need it - safely and reliably.
If you're passionate about driving change and looking for a place to make an impact, this is the place to be. It's an opportunity to do your life's best work.
Responsibilities
Key Responsibilities
1) Agentic AI Architecture & Delivery
Design and implement (multi) agentic workflows where LLMs plan, decompose tasks, invoke tools/APIs, and synthesize answers across heterogeneous data sources and services.
Build retrieval augmented generation (RAG) and hybrid search pipelines to power robust question answering over clinical and operational data.
Design, code, test, document, and maintain high quality, scalable Big Data and cloud solutions.
Develop scalable microservices and APIs for integrating agent capabilities into clinician tools and internal apps.
Create prototypes/POCs and conduct design/code reviews to derisk delivery and raise engineering quality.
2) LLMs, GenAI & Model Adaptation
Leverage and adapt LLMs; perform prompt engineering, grounding, guard railing, and domain adaptation for healthcare terminology and tasks.
Design intelligent frameworks and finetune models for compliance, accuracy, and ethical standards.
Establish evaluation frameworks (automatic + human in the loop) to measure faithfulness, helpfulness, bias, toxicity, privacy leakage, and overall quality.
3) Data & Platform Engineering
Partner with data engineering to build feature/retrieval stores, embeddings pipelines, and ETL/ELT jobs on Spark/Databricks; design analytics models and rules engines.
Define and develop APIs for integrations across the enterprise; improve data access patterns for low latency inference.
4) Delivery, MLOps & Reliability
Own MLOps/LLMOps: CI/CD for models/prompts, automated tests (unit/contract/eval), versioning, lineage, rollback; enable blue/green or canary releases.
Instrument SLOs/SLIs (latency, availability, hallucination/defect rate) and cost KPIs (tokens, GPU hours) with dashboards and alerts.
Lead production deployments on internal platforms (e.g., UAIS) with strong observability, reliability, and cost controls.
5) Security, Privacy & Compliance
Champion HIPAA and regulated industry controls; integrate access controls, PHI/PPI safeguards, data minimization, encryption, and auditability.
Collaborate with legal, compliance, and clinical safety to operationalize Responsible AI principles.
6) Product, Estimation & Collaboration
Analyze and define customer requirements; assist in defining product technical architecture and delivery roadmaps.
Provide effort estimates and inputs for resource planning; collaborate with QA, architecture, and peer teams.
Write technical documentation, support production, and mentor engineers, and keep skills current through continuous learning.
Skills
Must have
Required Qualifications
Bachelor's in Engineering, Computer Science, IT, or related fields.
10+ years of total technology experience
8+ years hands on software development/data engineering/analytics with strong AI/ML delivery (Azure preferred) with Scala, Python, PySpark.
4+ years hands on with Databricks.
4+ years with ADF/Airflow (orchestration/scaling).
4+ years with big data & streaming (Hadoop, MapReduce/HDFS, Spark, Kafka); Docker/Kubernetes.
4+ years with MySQL and NoSQL databases.
4+ years with Agile/Scrum, GitHub, Jenkins CI/CD, JUnit; strong coding standards and code reviews.
2+ years with LLMs & GenAI (Langchain, LangGraph, RAG, Vector DB, Azure Open AI, MCP Server, Agents, LangFuse).
2+ years of experience with container (Docker/Kubernetes)
1+ years with Proficiency building services or full stack apps (e.g., FastAPI/Flask, Node.js, React/Angular, TypeScript, HTML/CSS).
Preferred Qualifications
Healthcare experience; familiarity with clinical datasets.
SOA and enterprise integration concepts.
Experience working in regulated industries, with knowledge of ethical AI/ML practices and compliance requirements
Publications/patents or notable open-source contributions.
Excellent analysis, problem solving, and communication skills.
Nice to have
Exceptional communication skills.
Ability to deliver exceptional customer service with a positive attitude.
Other
Languages
English: C1 Advanced
Seniority
Senior
Join Our Team: Innovating Health Care with Cutting-Edge Technology
Combine two of the fastest-growing fields on the planet with a culture of performance, collaboration, and opportunity - and this is what you get. We are at the forefront of technology in an industry that is transforming the lives of millions. Here, innovation isn't just about creating another gadget; it's about making health care data accessible whenever and wherever people need it - safely and reliably.
If you're passionate about driving change and looking for a place to make an impact, this is the place to be. It's an opportunity to do your life's best work.
Responsibilities
Key Responsibilities
1) Agentic AI Architecture & Delivery
Design and implement (multi) agentic workflows where LLMs plan, decompose tasks, invoke tools/APIs, and synthesize answers across heterogeneous data sources and services.
Build retrieval augmented generation (RAG) and hybrid search pipelines to power robust question answering over clinical and operational data.
Design, code, test, document, and maintain high quality, scalable Big Data and cloud solutions.
Develop scalable microservices and APIs for integrating agent capabilities into clinician tools and internal apps.
Create prototypes/POCs and conduct design/code reviews to derisk delivery and raise engineering quality.
2) LLMs, GenAI & Model Adaptation
Leverage and adapt LLMs; perform prompt engineering, grounding, guard railing, and domain adaptation for healthcare terminology and tasks.
Design intelligent frameworks and finetune models for compliance, accuracy, and ethical standards.
Establish evaluation frameworks (automatic + human in the loop) to measure faithfulness, helpfulness, bias, toxicity, privacy leakage, and overall quality.
3) Data & Platform Engineering
Partner with data engineering to build feature/retrieval stores, embeddings pipelines, and ETL/ELT jobs on Spark/Databricks; design analytics models and rules engines.
Define and develop APIs for integrations across the enterprise; improve data access patterns for low latency inference.
4) Delivery, MLOps & Reliability
Own MLOps/LLMOps: CI/CD for models/prompts, automated tests (unit/contract/eval), versioning, lineage, rollback; enable blue/green or canary releases.
Instrument SLOs/SLIs (latency, availability, hallucination/defect rate) and cost KPIs (tokens, GPU hours) with dashboards and alerts.
Lead production deployments on internal platforms (e.g., UAIS) with strong observability, reliability, and cost controls.
5) Security, Privacy & Compliance
Champion HIPAA and regulated industry controls; integrate access controls, PHI/PPI safeguards, data minimization, encryption, and auditability.
Collaborate with legal, compliance, and clinical safety to operationalize Responsible AI principles.
6) Product, Estimation & Collaboration
Analyze and define customer requirements; assist in defining product technical architecture and delivery roadmaps.
Provide effort estimates and inputs for resource planning; collaborate with QA, architecture, and peer teams.
Write technical documentation, support production, and mentor engineers, and keep skills current through continuous learning.
Skills
Must have
Required Qualifications
Bachelor's in Engineering, Computer Science, IT, or related fields.
10+ years of total technology experience
8+ years hands on software development/data engineering/analytics with strong AI/ML delivery (Azure preferred) with Scala, Python, PySpark.
4+ years hands on with Databricks.
4+ years with ADF/Airflow (orchestration/scaling).
4+ years with big data & streaming (Hadoop, MapReduce/HDFS, Spark, Kafka); Docker/Kubernetes.
4+ years with MySQL and NoSQL databases.
4+ years with Agile/Scrum, GitHub, Jenkins CI/CD, JUnit; strong coding standards and code reviews.
2+ years with LLMs & GenAI (Langchain, LangGraph, RAG, Vector DB, Azure Open AI, MCP Server, Agents, LangFuse).
2+ years of experience with container (Docker/Kubernetes)
1+ years with Proficiency building services or full stack apps (e.g., FastAPI/Flask, Node.js, React/Angular, TypeScript, HTML/CSS).
Preferred Qualifications
Healthcare experience; familiarity with clinical datasets.
SOA and enterprise integration concepts.
Experience working in regulated industries, with knowledge of ethical AI/ML practices and compliance requirements
Publications/patents or notable open-source contributions.
Excellent analysis, problem solving, and communication skills.
Nice to have
Exceptional communication skills.
Ability to deliver exceptional customer service with a positive attitude.
Other
Languages
English: C1 Advanced
Seniority
Senior
Skills
Docker
FastAPI
Flask
Microservices
MySQL
Node.js
Scala
ETL
Encryption
MLOps
Scrum
Agile
Airflow
Angular
Azure
CSS
Databricks
HIPAA
HTML
Hadoop
JUnit
Jenkins
Kafka
Kubernetes
Python
React
TypeScript
Similar jobs
Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)
Capital One · Mc Lean, United States
1 hour ago$229.9k - $262.4k/yrLead AI Engineer (AI Foundations, LLM Customization and Finetuning)
Capital One · New York, United States
1 hour ago$197.3k - $225.1k/yrLead AI Engineer (FM Hosting, LLM Inference)
Capital One · Mc Lean, United States
1 hour ago$197.3k - $225.1k/yrSenior Lead AI Engineer(MLX, Agentic AI, Gen AI platform Services)
Capital One · Mc Lean, United States
1 hour ago$229.9k - $262.4k/yrAI Systems Engineer (SE-3)
Leidos · Fort Meade, United States
4 hours ago$107.9k - $195.1k/yrAI Systems Engineer (SE-3)
Leidos · Fulton, United States
4 hours ago$107.9k - $195.1k/yr