Quick overview
Job description
Job Title: AI Architect (GenAI / MLOps)
Location: Charlotte NC (Hybrid)
Position Overview
Turning promising AI ideas into production systems that are secure, compliant, and built to scale is the hard part of enterprise AI. This role sits at the center of that work. You’ll own the architecture for enterprise AI and GenAI solutions end to end, from data foundations and model selection through deployment, governance, and monitoring. You’ll work closely with business, data, engineering, and risk teams, and you’ll advise executives on what’s feasible, what’s worth it, and what the trade-offs are.
What You’ll Do / Key Responsibilities
- Design end-to-end AI/ML and GenAI architectures (RAG, agents, fine-tuning, model serving) that integrate with existing enterprise platforms
- Evaluate and select LLMs, vector databases, orchestration frameworks, and MLOps tooling
- Define reference architectures, patterns, and standards for reuse across teams
- Partner with data engineering on pipelines, feature stores, and data quality for AI workloads
- Build in responsible AI: model risk management, explainability, bias testing, audit trails, and regulatory compliance
- Establish MLOps/LLMOps practices covering CI/CD, evaluation, observability, drift detection, and cost control
- Lead proofs of concept and pilots, and move them to production
- Advise stakeholders and executives on AI strategy, feasibility, and trade-offs
- Mentor engineers and data scientists, and run architecture reviews
Required Qualifications
- 10+ years in software or data engineering, with 5+ years architecting AI/ML solutions in production
- Hands-on experience with LLMs and GenAI: prompt engineering, RAG, embeddings, and agent frameworks (e.g., LangChain, LlamaIndex)
- Strong Python skills and fluency in ML frameworks (PyTorch, TensorFlow, scikit-learn)
- Deep experience with at least one major cloud (AWS, Azure, or Google Cloud Platform) and its AI services (e.g., SageMaker, Bedrock, Azure OpenAI, Vertex AI)
- Experience with MLOps tooling (MLflow, Kubeflow, Docker, Kubernetes, CI/CD)
- Solid grounding in data architecture: data lakes/warehouses, streaming, APIs, and microservices
- Knowledge of security, privacy, and governance for AI systems
- Excellent communication, with the ability to explain technical trade-offs to non-technical leaders
Preferred Qualifications
- Experience in banking, insurance, or asset/wealth management, including regulatory expectations (e.g., SR 11-7 model risk)
- Experience with vector databases (Pinecone, pgvector, OpenSearch) and fine-tuning or evaluation frameworks
- Cloud or architecture certifications (e.g., AWS ML Specialty, Azure AI Engineer, TOGAF)
- Master’s or PhD in Computer Science, Data Science, or a related field
Similar jobs
- ST

AI Developer with Security Clearance
steampunk · McLean, VA · Hybrid · Posted 30 Oct 2026 🇺🇸
DockerMicroservicesNeo4j+15Technology$140k - $190k/yr - BF
GenAI Platform Lead / Senior Python AI EngineerRecently posted
BC Forward · Pennington, New Jersey · Hybrid · Posted 14 Nov 2026 🇺🇸
FastAPIMicroservicesMongoDB+16Technology$65 - $68/hr - PB
GenAI EngineerRecently posted
Prominds Business Consulting Inc · United States · Hybrid · Posted 13 Nov 2026 🇺🇸
DockerFlaskSQL+15TechnologySalary not listed - QT

AI ArchitectRecently posted
QUANTUM TECHNOLOGIES LLC · United States · On-site · Posted 13 Nov 2026 🇺🇸
DockerFastAPIMicroservices+14Technology€86/hr - TE
Gen AI Engineer - Austin, TX, Houston, TX, San Antonio, TX, Dallas, TX.Recently posted
TechniPros, LLC · Austin, TX · Hybrid · Posted 13 Nov 2026 🇺🇸
FastAPIFlaskSQL+11TechnologySalary not listed - ST
Azure Agentic AI ArchitectRecently posted
Software Technology Inc · United States · Hybrid · Posted 13 Nov 2026 🇺🇸
MLOpsLLMGenerative AI+7TechnologySalary not listed - CS

Ai EngineerRecently posted
Cyma Systems Inc · United States · Remote · Posted 13 Nov 2026 🇺🇸
AWSNLPComputer Vision+6TechnologySalary not listed - RI

AI Lead/ArchitectRecently posted
Rivago infotech inc · Jersey City, NJ · Hybrid · Posted 13 Nov 2026 🇺🇸
GitAWSMLflow+6Salary not listed - KT
AI Engineer – Enterprise AI Platform (Onsite 3–5 days per week)Recently posted
KayDev Technology, LLC · Houston, TX · On-site · Posted 13 Nov 2026 🇺🇸
AWSLLMPython+4TechnologySalary not listed - KA
Tech Lead/Data & AI ArchitectRecently posted
K Anand Corporation · Wilmington, MA · On-site · Posted 13 Nov 2026 🇺🇸
SQLETLAzureTechnologySalary not listed - CO

Senior Deployment Engineer - LLM Inference & OptimizationRecently posted Auto Apply
CoreWeave · Bellevue · Hybrid · Posted 14 Nov 2026 🇺🇸
SpringCUDAHugging Face+4Technology$188k - $275k/yr - SU
AI Architect - Hands on coding with good communicationRecently posted
SumasEdge Corporation · United States · Hybrid · Posted 13 Nov 2026 🇺🇸
Generative AIAzureLangGraph+1TechnologySalary not listed