Quick Overview
Seniority
Mid Senior
Work mode
Hybrid
Location
Charlotte, NC, United States
Posted
21 hours ago
DockerMicroservicesAWSMLOpsMLflowScikit-learnGoogle CloudPyTorchPythonTensorFlowGenerative AIAzureKubernetesPrompt EngineeringCI/CDLangChainRAG
Job Description
Job Title: AI Architect (GenAI / MLOps)
Position Overview
Turning promising AI ideas into production systems that are secure, compliant, and built to scale is the hard part of enterprise AI. This role sits at the center of that work. You’ll own the architecture for enterprise AI and GenAI solutions end to end, from data foundations and model selection through deployment, governance, and monitoring. You’ll work closely with business, data, engineering, and risk teams, and you’ll advise executives on what’s feasible, what’s worth it, and what the trade-offs are.
What You’ll Do / Key Responsibilities
- Design end-to-end AI/ML and GenAI architectures (RAG, agents, fine-tuning, model serving) that integrate with existing enterprise platforms
- Evaluate and select LLMs, vector databases, orchestration frameworks, and MLOps tooling
- Define reference architectures, patterns, and standards for reuse across teams
- Partner with data engineering on pipelines, feature stores, and data quality for AI workloads
- Build in responsible AI: model risk management, explainability, bias testing, audit trails, and regulatory compliance
- Establish MLOps/LLMOps practices covering CI/CD, evaluation, observability, drift detection, and cost control
- Lead proofs of concept and pilots, and move them to production
- Advise stakeholders and executives on AI strategy, feasibility, and trade-offs
- Mentor engineers and data scientists, and run architecture reviews
Required Qualifications
- 16+ years in software or data engineering, with 4+ years architecting AI/ML solutions in production
- Hands-on experience with LLMs and GenAI: prompt engineering, RAG, embeddings, and agent frameworks (e.g., LangChain, LlamaIndex)
- Strong Python skills and fluency in ML frameworks (PyTorch, TensorFlow, scikit-learn)
- Deep experience with at least one major cloud (AWS, Azure, or Google Cloud Platform) and its AI services (e.g., SageMaker, Bedrock, Azure OpenAI, Vertex AI)
- Experience with MLOps tooling (MLflow, Kubeflow, Docker, Kubernetes, CI/CD)
- Solid grounding in data architecture: data lakes/warehouses, streaming, APIs, and microservices
- Knowledge of security, privacy, and governance for AI systems
- Excellent communication, with the ability to explain technical trade-offs to non-technical leaders
Preferred Qualifications
- Experience in banking, insurance, or asset/wealth management, including regulatory expectations (e.g., SR 11-7 model risk)
- Experience with vector databases (Pinecone, pgvector, OpenSearch) and fine-tuning or evaluation frameworks
- Cloud or architecture certifications (e.g., AWS ML Specialty, Azure AI Engineer, TOGAF)
- Master’s or PhD in Computer Science, Data Science, or a related field
Similar jobs
- EI
AI Engineer III
NewElite IT Solutions inc
Houston, TX🇺🇸On-site21 hours agoTechnology - PT
AI Engineer
NewPeterson Technology Partners
Oak Brook, IL🇺🇸$70 - $75/hrOn-site21 hours agoSQLGitETL+6Technology - SS
Lead AI Engineer withAI agent logic
NewSIGNin Solutions Inc.
Chicago, IL🇺🇸On-site21 hours agoNeo4jPythonREST+4Technology - KI
AI Engineer (Maximum Rate: $40/hr)
NewKey Infotek LLC
United States🇺🇸$40/hrRemote21 hours agoGenerative AIHuman Resources - CG
AI Specialist
NewCCS Global Tech
Pontiac, MI🇺🇸Hybrid21 hours agoDockerGitGPT+4 - EN
917382 || Agentic AI Engineer (FDE)
NewExl Neo Technologies
United States🇺🇸On-site21 hours agoFastAPINestJSNext.js+15Technology - OR
ONA AI Agent Intern (Logistics Focus) - OVIP
NewOracle
Austin, Texas🇺🇸$19 - $36/hrHybrid1 hour agoOracleSQLCompliance+11 - VS
AI Engineer
NewVelocity Search Group Inc.
New York, NY🇺🇸Hybrid21 hours agoSQLGitHTML+10Technology - PM
AI Specialist
NewPMC
United States🇺🇸Hybrid21 hours agoDockerGitGPT+4 - VD
Gen AI Architect
NewVDart, Inc.
Cleveland, OH🇺🇸Hybrid21 hours agoMicroservicesMLOpsGDPR+11Technology - SS
Python Gen AI Developer
NewScadea Solutions Inc
Dallas, TX🇺🇸On-site21 hours agoDockerFastAPIFlask+15Technology - TC
Lead AI Engineer
NewThinkbyte Consulting, Inc.
United States🇺🇸Hybrid21 hours agoPythonAzureReact+3Technology