Quick overview
Job description
About CertifyOS
CertifyOS is building the data infrastructure that powers modern healthcare.
Today, healthcare organizations rely on fragmented and outdated provider data. This creates unnecessary administrative work, regulatory risk, and higher costs across the system. We’re solving that problem.
Our API-first platform automates provider licensing, enrollment, credentialing, and network monitoring by connecting directly to hundreds of primary data sources. We help healthcare organizations maintain accurate, compliant, and reliable provider networks at scale.
Our vision is simple: One API. One provider ID. Frictionless provider data.
We’re backed by leading investors and built by a team with deep experience in provider data systems. At CertifyOS, we value authenticity, accountability, collaboration, results, and openness to feedback. We’re building a high-ownership team focused on solving real infrastructure problems that impact millions of patients.
JOB DESCRIPTION
Role Overview
We are looking for hands-on engineers who can lead support automation initiatives while personally designing and building AI solutions end-to-end. This is a role for someone who can identify support problems, build AI/automation solutions, deploy them to production, and continuously improve them.
Key Responsibilities
- Identify high-impact support processes for AI/automation.
- Design, build, integrate, test and deploy AI-powered workflows and agents.
- Develop solutions using LLMs, RAG, AI agents and workflow automation.
- Build end-to-end AI pipelines covering knowledge/data ingestion, orchestration, model execution, tools/actions, evaluation and production monitoring.
- Integrate AI with CRM, ticketing, knowledge bases and internal tools.
- Monitor AI quality, accuracy, cost, latency and business impact; continuously improve solutions.
- Partner with Product and Engineering to drive AI-led transformation.
Ideal Experience
- 3+ years overall experience in software engineering, AI/ML, automation, technical operations or support technology.
- 2+ years of hands-on Generative AI/LLM application development, with demonstrated production experience.
- Experience in automation, integrations or workflow engineering.
- Strong experience taking AI/automation projects from concept and architecture through production and continuous improvement.
Must-Have Skills
- Strong Python and/or JavaScript/TypeScript.
- LLM APIs and Generative AI application development.
- RAG, embeddings, vector databases and knowledge pipelines.
- AI agents, agentic workflows, tool/function calling and MCP.
- End-to-end AI/LLM pipelines: ingestion → orchestration → model → tools/actions → evaluation → production.
- REST APIs, webhooks, SQL and system integrations.
- LLM evaluation, observability, guardrails, monitoring and cost/latency optimization.
- Production deployment, CI/CD and troubleshooting of AI/automation systems.
- Strong understanding of customer-support workflows and automation opportunities.
Preferred
Experience with OpenAI/Anthropic/Claude/Gemini, Claude Code, LangChain/LangGraph, LlamaIndex, n8n/Make/Zapier/Power Automate, vector databases, AI evaluation/observability tools, AWS/Azure/GCP, Docker and CRM/helpdesk platforms such as Zendesk, Salesforce, Jira, Freshdesk or Zoho.
What We Are Looking For
A builder, not just a strategist. The candidate should demonstrate real AI/automation solutions they have personally built or led, explain the architecture and their contribution, and quantify business impact such as automation %, ticket deflection, AHT reduction, cost savings or productivity gains.
Benefits of Working at Certify
At Certify, we’re building with intention and taking care of the people doing the work.
Your well-being matters to us. We provide 100% coverage of health, dental, and vision insurance premiums for employees. Our US-based team benefits from unlimited PTO, with at least two weeks off each year to recharge. In India, employees are supported with health insurance, statutory leave benefits, and additional wellness (menstrual) leave for women.
We are an equal opportunity employer committed to building an inclusive environment where everyone feels valued and empowered to do their best work, and we welcome applicants from all backgrounds and experiences.
If you require reasonable accommodations during the application process, please contact recruiting@certifyos.com.
We are also committed to pay transparency and foster an open culture where compensation conversations are encouraged and respected.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- B2
Lead AI Engineer I - R01573927Recently posted Auto Apply
Brillio 2 · Bengaluru · Hybrid · Posted 20 Nov 2026 🇮🇳
DockerMicroservicesOracle+13TechnologySalary not listed - CA

AI Engineer Auto Apply
Capco · Pune · Hybrid · Posted 12 Nov 2026 🇮🇳
MicroservicesSQLAWS+14TechnologySalary not listed - OA

Intern - Gen AIRecently posted Auto Apply
Oaknorth · Gurugram · Hybrid · Posted 18 Nov 2026 🇮🇳
Microsoft ExcelNPSNotion+4Salary not listed - TA

AI Infrastructure System EngineerRecently posted Auto Apply
Together AI · Bengaluru · Hybrid · Posted 17 Nov 2026 🇮🇳
RustAnsibleCUDA+5TechnologySalary not listed - GR
AI AssociateRecently posted Auto Apply
group.one · Ahmedabad · Hybrid · Posted 17 Nov 2026 🇮🇳
Digital MarketingGenerative AISalary not listed - SI
AI Architect (Product Architecture)Recently posted Auto Apply
Sia · Mumbai, Maharashtra · On-site · Posted 17 Nov 2026 🇮🇳
Generative AITechnologySalary not listed - BG
AI ArchitectRecently posted Auto Apply
Bosch Group · bengaluru · On-site · Posted 16 Nov 2026 🇮🇳
DockerGCPMongoDB+23TechnologySalary not listed - BA

AI EngineerRecently posted Auto Apply
Backbase · Hyderabad · Hybrid · Posted 19 Nov 2026 🇮🇳
LLMPythonGenerative AI+1TechnologySalary not listed - SH

Senior AI Product Builder (Pricing)Recently posted Auto Apply
ShipBob, Inc. · India · Remote · Posted 17 Nov 2026 🇮🇳
FigmaCustomer SuccessReconciliation+3Salary not listed - OR

AI Engineer– Microsoft FoundryRecently posted Auto Apply
Orbia · Pune · On-site · Posted 17 Nov 2026 🇮🇳
Microsoft OfficeGitApache Spark+20TechnologySalary not listed - OR

Lead Data & AI Engineer – Databricks Data Analytics & Agent BricksRecently posted Auto Apply
Orbia · Pune · Hybrid · Posted 17 Nov 2026 🇮🇳
SQLGitApache Spark+26TechnologySalary not listed - MA

AI Reliability Engineer (HPC)Recently posted Auto Apply
Microsoft AI · Bengaluru · Hybrid · Posted 17 Nov 2026 🇮🇳
DockerGCPMicrosoft Office+11TechnologySalary not listed
