Back to Jobs
Recently postedTechnology

Agentic AI Architect

Headway Tek IncAtlanta, GA🇺🇸United States

Quick overview

SeniorityMid Senior
Work modeHybrid
LocationAtlanta, GA, United States
Stakeholder ManagementDockerFastAPIMicroservicesMicrosoft OfficeAWSMLOpsDatabricksGoogle CloudLLMPythonGenerative AIRESTAzureKubernetesMachine LearningPrompt EngineeringCI/CDLangGraphRAG

Job description

Role : Agentic AI Architect

Location : Atlanta, Georgia

Full Time

Job Summary

We are seeking an experienced Agentic AI Architect to design, architect, and lead the implementation of enterprise-scale AI solutions powered by Large Language Models (LLMs), Agentic AI frameworks, Retrieval-Augmented Generation (RAG), knowledge graphs, and AI orchestration platforms. The ideal candidate will define end-to-end architectures for autonomous and semi-autonomous AI systems, establish security and governance guardrails, and drive adoption of next-generation AI capabilities across business functions. This role requires strong expertise in multi-agent orchestration, AI platform engineering, cloud-native architecture, enterprise integration, and hands-on technical leadership.

Key Responsibilities

  • AI and Agentic Architecture
  • Define enterprise Agentic AI strategy, target-state architecture, reusable patterns, and reference architectures.
  • Design multi-agent ecosystems using frameworks such as LangGraph, CrewAI, AutoGen, OpenAI Agents SDK, and
  • Microsoft Copilot Studio.
  • Architect supervisor, planner, executor, evaluator, and human-in-the-loop agent patterns.
  • Define approaches for reasoning, planning, task decomposition, memory management, tool use, context handling,
  • and agent collaboration.
  • Balance autonomy with deterministic controls, approval checkpoints, fallback mechanisms, and operational safety.
  • GenAI and RAG Solutions
  • Design scalable RAG architectures using enterprise knowledge repositories, semantic search, embeddings, vector
  • databases, and knowledge graphs.
  • Create enterprise copilots, AI assistants, and digital workforce solutions grounded in approved organizational data.
  • Define document ingestion, chunking, metadata, retrieval, reranking, citation, and response-generation patterns.
  • Establish evaluation methods for groundedness, hallucination, relevance, safety, quality, latency, and cost.
  • Enterprise Integration
  • Integrate AI agents with enterprise platforms such as SAP, ServiceNow, Salesforce, Microsoft 365, databases,
  • APIs, messaging platforms, and workflow engines.
  • Design secure API, event-driven, microservices, and tool-calling patterns for agent interactions.
  • Define identity, authorization, secrets management, data-access controls, and audit requirements for agent actions.
  • Create reusable integration contracts and Model Context Protocol (MCP) patterns where appropriate.
  • Governance and Responsible AI
  • Implement AI governance, safety guardrails, risk controls, and compliance checkpoints across the solution lifecycle.

JOB DESCRIPTION | AGENTIC AI ARCHITECT

Define human-in-the-loop and human-on-the-loop workflows for sensitive, high-impact, or irreversible actions.Establish model and agent monitoring, traceability, explainability, auditability, data privacy, bias assessment, and content-safety controls. Partner with security, legal, compliance, data governance, and risk teams to operationalize responsible AI standards.

Cloud and Platform Engineering

  • Architect solutions using Azure AI Foundry, Azure OpenAI, Microsoft Fabric, AWS Bedrock, Google Vertex AI, IBM
  • watsonx, or equivalent enterprise AI platforms.
  • Lead MLOps, LLMOps, and AgentOps architecture, including CI/CD, testing, release controls, observability,
  • rollback, and incident response.
  • Define scalable deployment patterns using containers, Kubernetes, serverless services, API gateways, and platform
  • engineering practices.
  • Optimize model selection, token consumption, caching, routing, latency, reliability, and infrastructure cost.
  • Technical Leadership and Stakeholder Engagement
  • Lead architecture reviews, design assurance, technology selection, prototyping, and production-readiness
  • assessments.
  • Translate business challenges into secure, scalable, and measurable Agentic AI solution designs.
  • Mentor AI engineers, data scientists, platform engineers, and solution architects.
  • Develop reusable frameworks, accelerators, templates, architecture decision records, and implementation
  • standards.
  • Communicate architecture, risks, trade-offs, roadmap, and business value to engineering teams and senior
  • stakeholders.

Required Core Technical Skills

  • Strong hands-on experience with Python, FastAPI, REST APIs, asynchronous processing, and distributed systems.
  • Deep understanding of LLMs, prompt engineering, structured outputs, function/tool calling, embeddings, and model
  • routing.
  • Experience with Agentic AI frameworks such as LangGraph, CrewAI, AutoGen, Semantic Kernel, or equivalent
  • technologies.
  • Expertise in RAG, vector databases, enterprise search, semantic retrieval, reranking, and knowledge graph
  • integration.
  • Experience with Azure, AWS, or Google Cloud Platform AI services and production-grade cloud architecture.
  • Working knowledge of Docker, Kubernetes, CI/CD, DevSecOps, observability, and secrets management.
  • Understanding of MCP, agent interoperability, context management, and secure tool integration.
  • AI Architecture Competencies
  • Multi-agent orchestration and agent design patterns
  • Reasoning, planning, memory, reflection, and evaluation strategies
  • LLM and agent evaluation frameworks
  • Responsible AI, security, privacy, and governance
  • Fine-tuning and model adaptation approaches
  • MLOps, LLMOps, and AgentOps operating models
  • Enterprise integration and API architecture

Qualifications

  • Bachelor's or master's degree in Computer Science, Artificial Intelligence, Data Science, Engineering, or a related
  • technical discipline.
  • 12+ years of overall IT experience, including substantial experience in enterprise architecture or solution
  • architecture.
  • 5+ years of experience in AI/ML, Generative AI, or advanced analytics architecture roles.
  • Demonstrated experience delivering enterprise-scale, production-grade AI platforms or applications.
  • Proven ability to lead cross-functional technical teams and engage business, security, risk, and executive
  • stakeholders.

Preferred Certifications

  • Microsoft Certified: Azure AI Engineer Associate
  • Microsoft Applied Skills credentials for Azure OpenAI or Azure AI solutions
  • AWS Certified Machine Learning - Specialty or relevant AWS AI certification
  • Google Cloud Professional Machine Learning Engineer
  • Databricks Generative AI Engineer or equivalent
  • TOGAF or another recognized enterprise architecture certification
  • Success Measures
  • Business value delivered through AI-enabled automation and decision support.
  • Agent task-completion quality, groundedness, safety, reliability, and user adoption.
  • Reusable architecture patterns and reduced time to production for AI use cases.
  • Effective control of LLM consumption, platform cost, latency, and operational risk.
  • Compliance with security, privacy, governance, audit, and responsible AI requirements.
  • Quality of technical leadership, architecture governance, and engineering enablement.

Similar jobs