Quick overview
Job description
Role : Agentic AI Architect
Location : Atlanta, Georgia
Full Time
Job Summary
We are seeking an experienced Agentic AI Architect to design, architect, and lead the implementation of enterprise-scale AI solutions powered by Large Language Models (LLMs), Agentic AI frameworks, Retrieval-Augmented Generation (RAG), knowledge graphs, and AI orchestration platforms. The ideal candidate will define end-to-end architectures for autonomous and semi-autonomous AI systems, establish security and governance guardrails, and drive adoption of next-generation AI capabilities across business functions. This role requires strong expertise in multi-agent orchestration, AI platform engineering, cloud-native architecture, enterprise integration, and hands-on technical leadership.
Key Responsibilities
- AI and Agentic Architecture
- Define enterprise Agentic AI strategy, target-state architecture, reusable patterns, and reference architectures.
- Design multi-agent ecosystems using frameworks such as LangGraph, CrewAI, AutoGen, OpenAI Agents SDK, and
- Microsoft Copilot Studio.
- Architect supervisor, planner, executor, evaluator, and human-in-the-loop agent patterns.
- Define approaches for reasoning, planning, task decomposition, memory management, tool use, context handling,
- and agent collaboration.
- Balance autonomy with deterministic controls, approval checkpoints, fallback mechanisms, and operational safety.
- GenAI and RAG Solutions
- Design scalable RAG architectures using enterprise knowledge repositories, semantic search, embeddings, vector
- databases, and knowledge graphs.
- Create enterprise copilots, AI assistants, and digital workforce solutions grounded in approved organizational data.
- Define document ingestion, chunking, metadata, retrieval, reranking, citation, and response-generation patterns.
- Establish evaluation methods for groundedness, hallucination, relevance, safety, quality, latency, and cost.
- Enterprise Integration
- Integrate AI agents with enterprise platforms such as SAP, ServiceNow, Salesforce, Microsoft 365, databases,
- APIs, messaging platforms, and workflow engines.
- Design secure API, event-driven, microservices, and tool-calling patterns for agent interactions.
- Define identity, authorization, secrets management, data-access controls, and audit requirements for agent actions.
- Create reusable integration contracts and Model Context Protocol (MCP) patterns where appropriate.
- Governance and Responsible AI
- Implement AI governance, safety guardrails, risk controls, and compliance checkpoints across the solution lifecycle.
JOB DESCRIPTION | AGENTIC AI ARCHITECT
Define human-in-the-loop and human-on-the-loop workflows for sensitive, high-impact, or irreversible actions.Establish model and agent monitoring, traceability, explainability, auditability, data privacy, bias assessment, and content-safety controls. Partner with security, legal, compliance, data governance, and risk teams to operationalize responsible AI standards.
Cloud and Platform Engineering
- Architect solutions using Azure AI Foundry, Azure OpenAI, Microsoft Fabric, AWS Bedrock, Google Vertex AI, IBM
- watsonx, or equivalent enterprise AI platforms.
- Lead MLOps, LLMOps, and AgentOps architecture, including CI/CD, testing, release controls, observability,
- rollback, and incident response.
- Define scalable deployment patterns using containers, Kubernetes, serverless services, API gateways, and platform
- engineering practices.
- Optimize model selection, token consumption, caching, routing, latency, reliability, and infrastructure cost.
- Technical Leadership and Stakeholder Engagement
- Lead architecture reviews, design assurance, technology selection, prototyping, and production-readiness
- assessments.
- Translate business challenges into secure, scalable, and measurable Agentic AI solution designs.
- Mentor AI engineers, data scientists, platform engineers, and solution architects.
- Develop reusable frameworks, accelerators, templates, architecture decision records, and implementation
- standards.
- Communicate architecture, risks, trade-offs, roadmap, and business value to engineering teams and senior
- stakeholders.
Required Core Technical Skills
- Strong hands-on experience with Python, FastAPI, REST APIs, asynchronous processing, and distributed systems.
- Deep understanding of LLMs, prompt engineering, structured outputs, function/tool calling, embeddings, and model
- routing.
- Experience with Agentic AI frameworks such as LangGraph, CrewAI, AutoGen, Semantic Kernel, or equivalent
- technologies.
- Expertise in RAG, vector databases, enterprise search, semantic retrieval, reranking, and knowledge graph
- integration.
- Experience with Azure, AWS, or Google Cloud Platform AI services and production-grade cloud architecture.
- Working knowledge of Docker, Kubernetes, CI/CD, DevSecOps, observability, and secrets management.
- Understanding of MCP, agent interoperability, context management, and secure tool integration.
- AI Architecture Competencies
- Multi-agent orchestration and agent design patterns
- Reasoning, planning, memory, reflection, and evaluation strategies
- LLM and agent evaluation frameworks
- Responsible AI, security, privacy, and governance
- Fine-tuning and model adaptation approaches
- MLOps, LLMOps, and AgentOps operating models
- Enterprise integration and API architecture
Qualifications
- Bachelor's or master's degree in Computer Science, Artificial Intelligence, Data Science, Engineering, or a related
- technical discipline.
- 12+ years of overall IT experience, including substantial experience in enterprise architecture or solution
- architecture.
- 5+ years of experience in AI/ML, Generative AI, or advanced analytics architecture roles.
- Demonstrated experience delivering enterprise-scale, production-grade AI platforms or applications.
- Proven ability to lead cross-functional technical teams and engage business, security, risk, and executive
- stakeholders.
Preferred Certifications
- Microsoft Certified: Azure AI Engineer Associate
- Microsoft Applied Skills credentials for Azure OpenAI or Azure AI solutions
- AWS Certified Machine Learning - Specialty or relevant AWS AI certification
- Google Cloud Professional Machine Learning Engineer
- Databricks Generative AI Engineer or equivalent
- TOGAF or another recognized enterprise architecture certification
- Success Measures
- Business value delivered through AI-enabled automation and decision support.
- Agent task-completion quality, groundedness, safety, reliability, and user adoption.
- Reusable architecture patterns and reduced time to production for AI use cases.
- Effective control of LLM consumption, platform cost, latency, and operational risk.
- Compliance with security, privacy, governance, audit, and responsible AI requirements.
- Quality of technical leadership, architecture governance, and engineering enablement.
Similar jobs
- OT
Principal AI EngineerRecently posted
Oscar Technology · United States · Remote · Posted 17 Nov 2026 🇺🇸
SQLLLMPython+2Technology$275k - $325k/yr - PA
AI ArchitectRecently posted
PHX Agile LLC · Los Angeles, CA · Hybrid · Posted 16 Nov 2026 🇺🇸
DockerMicroservicesAWS+16TechnologySalary not listed - PH

Agentic AI EngineerRecently posted
Photon · Dallas, TX · Hybrid · Posted 17 Nov 2026 🇺🇸
MicroservicesOAuthLLM+4TechnologySalary not listed - PH

Sr. AI EngineerRecently posted
Photon · Dallas, TX · On-site · Posted 16 Nov 2026 🇺🇸
NLPGPTHIPAA+6TechnologySalary not listed - AS

AI Developer (Claude, Splunk)Recently posted
Arnex Solutions LLC · Chicago, IL · Hybrid · Posted 16 Nov 2026 🇺🇸
SplunkPythonCI/CDTechnologySalary not listed - C3

AI Architect - Gemini Google Cloud PlatformRecently posted
Codeforce 360 · Milton, GA · Hybrid · Posted 16 Nov 2026 🇺🇸
BigQueryGoogle CloudLLM+5TechnologySalary not listed - SI

Applied AI Scientist/Researcher (Senior/Staff) - VC Backed StartupsRecently posted Auto Apply
Signalfire · Remote - No Preference · Remote · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionScikit-learnSnowflake+11Salary not listed - SI

Applied AI Scientist/Researcher (Senior/Staff) - VC Backed StartupsRecently posted Auto Apply
Signalfire · NYC - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionScikit-learnSnowflake+11Salary not listed - SI

Applied AI Scientist/Researcher (Senior/Staff) - VC Backed StartupsRecently posted Auto Apply
Signalfire · Bay Area - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionScikit-learnSnowflake+11Salary not listed - SI

Founding AI Engineer (Senior/Staff) - VC Backed StartupsRecently posted Auto Apply
Signalfire · Remote - No Preference · Remote · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDockerFastAPI+23TechnologySalary not listed - SI

Founding AI Engineer (Senior/Staff) - VC Backed StartupsRecently posted Auto Apply
Signalfire · NYC - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDockerFastAPI+23TechnologySalary not listed - SI

Founding AI Engineer (Senior/Staff) - VC Backed StartupsRecently posted Auto Apply
Signalfire · Bay Area - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDockerFastAPI+23TechnologySalary not listed
