Quick overview
Job description
You will work closely with AI engineers, data teams, and platform engineers to design, deploy, and operate production-grade AI services used by external customers in highly regulated environments. This is a hands-on engineering position focused on building reliable, scalable, secure systems that support model serving, agent workflows, retrieval-augmented generation (RAG), observability, and AI lifecycle management.
The ideal candidate has a track record of owning critical platform components in production and has experience operating AI systems that support real-world users at scale. Required Skills & Experience
- 7+ years of software engineering and infrastructure engineering experience
- Strong background building distributed, cloud-native systems in production environments
- Production experience with AI/ML infrastructure, model deployment, and lifecycle management
- Hands-on experience deploying and operating LLM-based applications in production
- Experience with RAG architectures, embeddings, model versioning, and tool/function calling
- Strong Python and TypeScript development skills
- Experience designing and building REST APIs and OpenAPI-based services
- Experience with AWS cloud services and containerized workloads
- Familiarity with Infrastructure as Code tools such as CloudFormation or AWS CDK
- Experience implementing CI/CD pipelines and deployment automation
- Experience with observability, monitoring, logging, alerting, and distributed tracing
- Experience supporting multi-tenant platforms and handling sensitive data
- Strong communication skills and ability to contribute to technical direction
- Experience with Databricks MLflow
- Experience with model registries, versioning, and model serving platforms
- Experience building AI evaluation frameworks and quality monitoring systems
- Knowledge of AI security practices including prompt injection protection and tool abuse prevention
- Experience supporting regulated environments requiring auditability and reproducibility
- Experience mentoring engineers and leading technical design reviews
- Experience evaluating AI frameworks, model providers, and serving technologies
- 100% Hands On
- Design, build, and operate AI platform services and APIs
- Own model and prompt lifecycle management across production environments
- Develop infrastructure supporting model serving, inference, and agent-based systems
- Implement RAG capabilities and AI-powered workflows
- Build evaluation, testing, and quality assurance tooling for AI systems
- Establish monitoring, alerting, logging, and observability standards
- Partner with security teams to implement AI and platform security controls
- Build scalable, multi-tenant cloud services supporting enterprise customers
- Develop Infrastructure as Code and deployment automation solutions
- Participate in architecture reviews and technical design discussions
- Create documentation and mentor engineers across the organization
- Support production reliability, performance optimization, and incident response
- Competitive base salary of $170,000 - $220,000
- Equity opportunity
- Flexible work arrangements
- Unlimited PTO
- 401(k)
- Company-paid life and disability insurance
- Medical Insurance
- Dental Benefits
- Vision Benefits
- Paid Time Off (PTO)
- 401(k)
Similar jobs
- SA

Senior Manager, Software Engineering - AI Developer Productivity (Dev Agents and SRE AI)Recently posted Auto Apply
Samsara · Remote - US · Remote · Posted 14 Nov 2026 🇺🇸
Customer SuccessGreenhouseIoT+3Technology$162.4k/yr - AS
Azure DevOps & High-Performance Computing EngineerRecently posted
Alchemy Software Solutions LLC · San Jose, CA · On-site · Posted 13 Nov 2026 🇺🇸
AnsibleChefPowerShell+5TechnologySalary not listed - RD

Site Reliability EngineerRecently posted
Randstad Digital · Chandler, AZ · Hybrid · Posted 13 Nov 2026 🇺🇸
OracleSQLShell+15Technology$56 - $66/hr - RE

VMware EngineerRecently posted
Recru, LLC · Houston, TX · Hybrid · Posted 13 Nov 2026 🇺🇸
PowerShellAWSAzure+3TechnologySalary not listed - MI
DevSecOps EngineerRecently posted
Mindlance · Washington, DC · On-site · Posted 13 Nov 2026 🇺🇸
SAFeGISAgileEngineeringSalary not listed - IF

AI Lead Platform Engineer - Chicago, IL, USA -Local profiles onlyRecently posted
iFusion Inc. · Chicago, IL · On-site · Posted 14 Nov 2026 🇺🇸
MLOpsAzureCI/CDTechnologySalary not listed - GD

DevOps Engineer InternRecently posted
General Dynamics · Pittsburgh, PA · Hybrid · Posted 14 Nov 2026 🇺🇸
DockerGitAnsible+9TechnologySalary not listed - EM

DevOps Security EngineerRecently posted Auto Apply
Emerson · Shakopee · Hybrid · Posted 14 Nov 2026 🇺🇸
GitGitHub ActionsGitLab CI+5Technology$80k - $115k/yr - AP

Software Engineer (DevOps) with Security ClearanceRecently posted
Ardent Principles · Reston, VA · Hybrid · Posted 13 Nov 2026 🇺🇸
DockerGCPAWS+9Technology$130k - $260k/yr - SY
Data Center Site Reliability EngineerRecently posted
Synopsys, Inc. · Canonsburg, PA · On-site · Posted 13 Nov 2026 🇺🇸
BashPowerShellPython+1TechnologySalary not listed - OR

Senior Principal Site Reliability EngineerRecently posted
Oracle Corporation · Nashville, TN · Hybrid · Posted 13 Nov 2026 🇺🇸
OracleTerraformKubernetes+2Technology$110.8k - $234.6k/yr - SS

Senior Cloud DevOps EngineerRecently posted
Sriven Systems Inc. · United States · Hybrid · Posted 13 Nov 2026 🇺🇸
GitAWSCloudFormation+4TechnologySalary not listed
