Quick Overview
Job Description
Key Responsibilities
Design and maintain an AI productization and governance framework covering service patterns, security and compliance standards, model evaluation criteria, and production-readiness requirements
Build and maintain reusable internal tooling for AI service scaffolding, model evaluation, monitoring, and data infrastructure
Establish governance policies for AI agents, including permissions, code execution controls, access to internal systems, and human-in-the-loop requirements
Partner with Security, Legal, and Compliance teams to define AI controls, vendor data processing requirements, and prompt data classification practices
Establish standardized deployment patterns using containerization, Infrastructure as Code, and reusable CI/CD pipeline templates
Design and operate multi-tenant AI services and LLM integrations in production environments
Lead microservices architecture initiatives, including monolith decomposition, service contract definition, and CI/CD implementation for distributed systems
Champion AI-assisted development practices, including LLM-integrated development workflows, test-driven development, and reusable engineering tooling
Establish and promote modern software engineering standards covering CI/CD, DevOps, testing, and delivery quality
Mentor engineers and technical leads to improve delivery consistency, design quality, and production readiness
Serve as a technical authority on AI/ML, platform architecture, and engineering practices
Translate complex architectural decisions, AI risks, and platform tradeoffs into clear guidance for technical and non-technical stakeholders
Collaborate with cross-functional product teams using Agile methodologies
Support AI/ML platform strategy, architecture, implementation, security, governance, and continuous improvement
Required Qualifications
15+ years of experience
Bachelor's degree in Computer Science, Engineering, or a related field
Advanced certifications in AI or deep learning
AWS Certification
Google Cloud Platform Certification
Azure ML Certification
CISSP
English
Skills
AI/ML Frameworks
Python
Public Cloud Model Deployment
Multi-tenant AI Services
LLM Integrations
Docker
Terraform
DevOps
CI/CD Pipeline Design
Microservices Architecture
Go
TypeScript
Test-driven Development
AI-assisted Development Workflows
AI Service Interface and Gateway Design
Cloud Architecture
AI Governance
AI Security and Threat Modeling
Microservices Architecture
Platform Architecture
Technical Leadership
Mentoring and Coaching
Stakeholder Communication
Executive Presentations
Agile Delivery
Cross-functional Collaboration
Developer Education and Workshops
Open-Source Contributions
AI Compliance Controls
Schedule
Start date: 2026-10-05
Similar jobs
- AC
AI Architect & Governance
NewASoft Consulting LLC
Washington, DC🇺🇸Hybrid20 hours agoGenerative AIStakeholder ManagementTechnology - ID
Senior Python AI Engineer - Only W2
NewInfo Dinamica Inc
AK🇺🇸Remote20 hours agoDockerFastAPINeo4j+11Technology - VC
Senior AI Engineer
NewV-Soft Consulting Group, Inc
United States🇺🇸Hybrid20 hours agoMachine LearningScrumAzure+2Technology - CG
AI Engineer / AI Builder public sector candidate only
NewCrowdplum Global Services LLC
Springfield, IL🇺🇸On-site20 hours agoDockerFastAPIAWS+7Technology - PH
AI Engineer
NewPhoton
Dallas, TX🇺🇸On-site20 hours agoNLPGPTHIPAA+4Technology - RI
AI Architect
NewRivago infotech inc
Paramus, NJ🇺🇸On-site20 hours agoMLOpsMachine LearningSnowflake+6Technology