Quick overview
Job description
Senior AI Engineer
Plano, TX
12+ Months
Core Software Engineering
- 8+ years of experience in software engineering with strong expertise in Python.
- Hands-on experience designing and developing microservices-based architectures using FastAPI or similar Python frameworks.
- Experience building scalable, secure, and production-grade APIs.
Cloud & Data Platforms
- Strong experience with Microsoft Azure, including AI, data, and application services.
- Expertise in MongoDB and NoSQL database design, optimization, and data modeling.
- Experience deploying and managing cloud-native applications and containerized workloads.
Generative AI & Agentic Systems
- Proven experience developing Generative AI solutions using modern LLM frameworks.
- Hands-on experience building AI Agents, multi-agent systems, and autonomous workflows.
- Strong understanding of Retrieval-Augmented Generation (RAG) architectures, including:
- Knowledge RAG
- Graph RAG
- Hybrid retrieval systems
- Context-aware retrieval pipelines
- Experience designing enterprise knowledge bases, semantic search solutions, and context-building frameworks.
Large Language Models
- Strong understanding of Large Language Models (LLMs) and Small Language Models (SLMs).
- Experience with model selection, prompt engineering, grounding strategies, fine-tuning approaches, and inference optimization.
- Familiarity with model performance, latency, cost optimization, and governance considerations.
AI Evaluation & Observability
- Hands-on experience implementing Agentic Evaluation frameworks, including tools such as DeepEval.
- Experience designing evaluation metrics for:
- Retrieval quality
- Hallucination detection
- Answer relevance
- Agent task completion
- Safety and reliability
- Experience with AI observability and monitoring platforms, particularly Arize AI, for production monitoring, tracing, and model performance analysis.
Preferred Qualifications
- Experience with vector databases and embedding models.
- Familiarity with LangChain, LangGraph, Semantic Kernel, LlamaIndex, or similar AI orchestration frameworks.
- Experience building enterprise AI applications with governance, security, and compliance considerations.
- Knowledge of MLOps/LLMOps practices, CI/CD pipelines, and model lifecycle management.
- Experience working in Agile product development environments.
Key Responsibilities
- Design and develop scalable AI-powered microservices and APIs using Python and FastAPI.
- Build and maintain enterprise-grade RAG and Graph RAG solutions.
- Develop intelligent agentic workflows that leverage organizational knowledge and business context.
- Optimize knowledge retrieval, context orchestration, and response quality for AI applications.
- Implement evaluation frameworks and monitoring solutions using DeepEval and Arize.
- Deploy, monitor, and maintain AI applications on Azure.
- Collaborate with product, engineering, and business teams to translate use cases into production-ready AI solutions.
Must have existing hands on experience
- Azure AI Foundry
- Azure OpenAI Service
- Semantic Kernel
- LangGraph
- Neo4j or Graph Databases
- Vector Databases (Azure AI Search, Pinecone, Weaviate, Qdrant)
- Kubernetes and Docker
- GitHub Actions / Azure DevOps
This version is targeted at a S Generative AI Engineer (7-10+ years experience).
Similar jobs
- BW

AI Systems & Solutions Engineer
BWXT · Oak Ridge, TN · Hybrid 🇺🇸
DockerMicroservicesGit+12Technology$86.5k/yr - TU

AI Engineer – Manufacturing & ProductionRecently posted Auto Apply
Tutorintelligence · Watertown · On-site · Posted 16 Nov 2026 🇺🇸
SQLRoboticsCAD+5Manufacturing$150k - $190k/yr - BE
Artificial Intelligence EngineerRecently posted
BeaconFire Inc. · Mundelein, Illinois · Hybrid · Posted 16 Nov 2026 🇺🇸
ScrumGenerative AIAgileEngineering$62k - $80k/yr - TT
Founding AI Agent EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 16 Nov 2026 🇺🇸
RecruitingClinical TrialsOutreach+2$150k - $220k/yr - TT
AI SchedulerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 16 Nov 2026 🇺🇸
BIMConstruction ManagementPrimavera P6+2$140k - $200k/yr - TT
Founding AI EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 15 Nov 2026 🇺🇸
Next.jsPlaywrightNode.js+1Technology$216k - $250k/yr - HA
AI Solutions EngineerRecently posted
Harris · TN · Hybrid · Posted 15 Nov 2026 🇺🇸
HIPAAGenerative AICI/CDTechnology$110k - $150k/yr - ER

Head of Applied AI Auto Apply
Eragon · San Francisco · On-site · Posted 30 Oct 2026 🇺🇸
$350k - $500k/yr - OR
Research Engineer, AIRecently posted Auto Apply
Orbis · Remote - US · Remote · Posted 13 Nov 2026 🇺🇸
LLMPythonMachine LearningEngineeringSalary not listed - OR
Research Engineer, AI (Entry-Level) Auto Apply
Orbis · Remote - US · Remote · Posted 3 Nov 2026 🇺🇸
DockerLLMPython+2Salary not listed - WI
AI Value Delivery Lead (Partner Motion) Auto Apply
Within.ai · San Francisco (HQ) · On-site 🇺🇸
Six SigmaGenerative AISlackOperations & Project ManagementSalary not listed - CO

AI Engineer 4 (MLX, Agentic AI, Gen AI platform Services)Recently posted
Capital One · New York · Hybrid 🇺🇸
ScalaAWSC#+11Technology$197.3k - $225.1k/yr
