Quick overview
Job description
Title: AI Architect (GenAI / MLOps) 245662
Location: Charlotte, NC (Hybrid)
Duration: Full Time
What this role is: A hands-on, enterprise-level AI/GenAI architect who owns the full lifecycle: data foundations, model and tooling selection, production deployment, governance, and monitoring. They take use cases from business, data, engineering, and risk teams and turn them into scalable, secure, compliant production systems.
Level: Senior architect. The 10+ years of experience and 4+ years architecting AI/ML in production put this above a typical senior engineer. The role also includes executive advising, mentoring, and running architecture reviews.
Notes: Production GenAI/LLM architecture (RAG, agents) together with classic ML/MLOps depth, plus responsible-AI and governance experience (model risk, explainability, bias testing, audit trails) and executive-level communication. Many candidates are strong in one or two of these but not all.
Key Responsibilities
· Design end-to-end AI/ML and GenAI architectures (RAG, agents, fine-tuning, model serving) that integrate with existing enterprise platforms
· Evaluate and select LLMs, vector databases, orchestration frameworks, and MLOps tooling
· Define reference architectures, patterns, and standards for reuse across teams
· Partner with data engineering on pipelines, feature stores, and data quality for AI workloads
· Build in responsible AI: model risk management, explainability, bias testing, audit trails, and regulatory compliance
· Establish MLOps/LLMOps practices covering CI/CD, evaluation, observability, drift detection, and cost control
· Lead proofs of concept and pilots, and move them to production
· Advise stakeholders and executives on AI strategy, feasibility, and trade-offs
· Mentor engineers and data scientists, and run architecture reviews
Required Qualifications
· 10+ years in software or data engineering, with 4+ years architecting AI/ML solutions in production
· Hands-on experience with LLMs and GenAI: prompt engineering, RAG, embeddings, and agent frameworks (e.g., LangChain, LlamaIndex)
· Strong Python skills and fluency in ML frameworks (PyTorch, TensorFlow, scikit-learn)
· Deep experience with at least one major cloud (AWS, Azure, or Google Cloud Platform) and its AI services (e.g., SageMaker, Bedrock, Azure OpenAI, Vertex AI)
· Experience with MLOps tooling (MLflow, Kubeflow, Docker, Kubernetes, CI/CD)
· Solid grounding in data architecture: data lakes/warehouses, streaming, APIs, and microservices
· Knowledge of security, privacy, and governance for AI systems
· Excellent communication, with the ability to explain technical trade-offs to non-technical leaders
Preferred Qualifications
· Experience in banking, insurance, or asset/wealth management, including regulatory expectations (e.g., SR 11-7 model risk)
· Experience with vector databases (Pinecone, pgvector, OpenSearch) and fine-tuning or evaluation frameworks
· Cloud or architecture certifications (e.g., AWS ML Specialty, Azure AI Engineer, TOGAF)
· Master’s or PhD in Computer Science, Data Science, or a related field
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- AG

AWS Bedrock AI Engineer - , CARecently posted
ASCII Group LLC · Irvine, CA · Hybrid · Posted 18 Nov 2026 🇺🇸
AWSTechnologySalary not listed - RH

AI Workflow ArchitectRecently posted
Robert Half · Chicago, IL · Hybrid · Posted 19 Nov 2026 🇺🇸
MLOpsAirflowApache+3Salary not listed - PT
AI Engineer Generative AI & Agentic AI at RemoteRecently posted
PropelSys Technologies LLC. · AK · Remote · Posted 18 Nov 2026 🇺🇸
DockerFastAPISQL+28TechnologySalary not listed - MR

Senior AI EngineerRecently posted
Motion Recruitment Partners, LLC · Boston, MA · Hybrid · Posted 19 Nov 2026 🇺🇸
LLMTypeScriptCI/CD+1TechnologySalary not listed - SW
AI EngineerRecently posted
STS Worldwide Inc. · United States · Hybrid · Posted 19 Nov 2026 🇺🇸
DockerFastAPIFlask+26TechnologySalary not listed - NF

AI Engineer (Agentic AI)Recently posted Auto Apply
Navy Federal Credit Union · Vienna · Hybrid · Posted 18 Nov 2026 🇺🇸
DjangoFlaskSQL+17TechnologySalary not listed - TH

AI Services ConsultantRecently posted
The Hollister Group · Framingham, MA · Remote · Posted 18 Nov 2026 🇺🇸
Microsoft OfficeCustomer SuccessRisk Management$150k - $200k/yr - RI

AI Technical LeadRecently posted
Rayven IT Solutions · United States · Hybrid · Posted 18 Nov 2026 🇺🇸
ERPSAPGenerative AI+1Salary not listed - SA
Head of Neuro-Symbolic AIRecently posted Auto Apply
Sapience AI Corporation · Seattle · Remote · Posted 18 Nov 2026 🇺🇸
Neo4jLLMPyTorch+2Salary not listed - DI

Enterprise AI ArchitectRecently posted
Diceforce IT LLC · United States · Hybrid · Posted 18 Nov 2026 🇺🇸
AWSAzureTechnologySalary not listed - WG
Lead AI EngineerRecently posted
Whiz Global LLC · East Hartford, CT · Hybrid · Posted 18 Nov 2026 🇺🇸
FastAPIMicroservicesMongoDB+12TechnologySalary not listed - BT
Conversational AI EngineerRecently posted
Balin Technologies LLC · Atlanta, GA · Hybrid · Posted 18 Nov 2026 🇺🇸
AWSLLMPrompt Engineering+2TechnologySalary not listed
