Haystack
← Back to Jobs
Remote
Technology
PA

AI Engineer (Agentic AI) - Hybrid/Remote- 6 months

Palni IncExton, PA🇺🇸United StatesPosted 3 Sept 2026

Quick Overview

Seniority
Mid Senior
Work mode
Remote
Location
Exton, PA, United States
Posted
18 hours ago
FastAPIAWSAzureLLMPostgreSQLPython

Job Description

AI Engineer (Agentic AI)
Location: Exton, PA (HQ) ·
Work Mode: Hybrid and Open to Remote for senior candidates
Type: 6 Months
 
Job Summary
We are looking for AI Engineer (Agentic AI) to build and deploy production-grade AI agents for healthcare decision workflows.
The ideal candidate will have strong production Python experience, hands-on expertise with agentic AI and RAG systems, and the ability to work directly with healthcare stakeholders.
 
This role is focused on building, evaluating, and deploying AI systems that operate reliably in real-world environments.
 
Key Responsibilities
  • Design and build multi-agent workflows, agent graphs, and orchestration systems for healthcare use cases.
  • Develop production RAG pipelines over clinical, regulatory, and structured data sources.
  • Build evaluation frameworks, regression suites, and quality gates for AI systems.
  • Implement deterministic guardrails, human-in-the-loop workflows, and failure-handling mechanisms.
  • Develop production services using Python, FastAPI, PostgreSQL, and vector databases.
  • Work with clinical reviewers, medical directors, payer teams, and customer engineering teams to improve AI outcomes.
  • Own the end-to-end delivery of AI solutions from development through production.
  • Use Claude and other AI coding tools effectively across development, testing, and documentation.
Required Skills
  • Hands on experience in production software engineering experience.
  • Hands on experience in building and deploying LLM or ML systems in production.
  • Strong Python development experience.
  • Hands-on experience with agentic AI, multi-agent systems, or production orchestration frameworks.
  • Strong experience with RAG, retrieval evaluation, reranking, and citation traceability.
  • Experience building AI evaluation frameworks and quality gates.
  • Experience with FastAPI, async Python, PostgreSQL, and vector databases such as pgvector or ChromaDB.
  • Strong understanding of prompt engineering, structured outputs, tool calling, and context management.
  • Strong communication and customer-facing skills.
Nice-to-Have Skills
  • LangGraph, LangChain, DSPy, or Temporal.
  • Fine-tuning, LoRA, distillation, or preference optimization.
  • Open-weight inference using vLLM, Ollama, or llama.cpp.
  • Vision-language models and document extraction.
  • MCP server development or Claude Skills.
  • FHIR, X12 278, NCPDP SCRIPT, or healthcare interoperability experience.
  • Azure Government, AWS GovCloud, sovereign, or air-gapped deployments.
  • Anthropic Claude API or Claude Code experience at production scale.
  • Healthcare domain knowledge is preferred: CPT, ICD-10, HCPCS, NCD/LCD, medical necessity criteria, and PHI handling.

Similar jobs