Haystack
← Back to Jobs
Technology
PA

AI Architect

PHX Agile LLCCharlotte, NC🇺🇸United StatesPosted Sep 18, 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
Charlotte, NC, United States
Posted
20 hours ago
DockerMicroservicesAWSMLOpsAzureGenerative AIGoogle CloudKubernetesLLMPythonREST

Job Description

AI Architect

Location: Charlotte, NC
Experience: 14+ Years

Job Overview

We are looking for an experienced AI Architect to design and lead enterprise AI, Generative AI, LLM, RAG, and Agentic AI solutions.

Key Responsibilities

  • Design scalable AI/GenAI and LLM architectures for enterprise applications.
  • Architect RAG pipelines, AI Agents, LLM orchestration, and knowledge systems.
  • Work with Azure OpenAI, Azure AI Foundry, AWS Bedrock, or Google Vertex AI.
  • Design solutions using LangChain, LangGraph, LlamaIndex, or Semantic Kernel.
  • Integrate LLMs, vector databases, APIs, microservices, and enterprise data sources.
  • Define AI security, governance, guardrails, privacy, and responsible AI practices.
  • Lead MLOps/LLMOps, CI/CD, monitoring, model evaluation, and production deployments.
  • Collaborate with engineering, data, cloud, security, and product teams.

Required Skills

  • 10+ years in Software Engineering / AI / ML / Architecture.
  • Strong Python experience.
  • Hands-on GenAI, LLM, RAG, and Agentic AI experience.
  • Strong knowledge of Azure / AWS / Google Cloud Platform.
  • Experience with Vector DBs, REST APIs, Microservices, Docker, Kubernetes.
  • Experience with LangChain / LangGraph / LlamaIndex.
  • Strong understanding of AI security, governance, and LLM evaluation.

Similar jobs