Why this role stands out
Step into a pivotal leadership role where you will shape the future of generative AI infrastructure at a rapidly growing organization while enjoying the convenience of a fully remote setup. This position is perfect for a seasoned engineer who thrives on designing scalable, cloud-native systems and wants to drive technical strategy within a collaborative, high-impact team. Apply today to advance your career at the forefront of the AI revolution and build cutting-edge solutions at scale.
Quick overview
Job description
In this position, you will lead the architecture, deployment, and operational strategy for production-grade AI services, machine learning platforms, and large language model (LLM) solutions. You will work closely with AI engineers, data teams, and platform engineers to create scalable, secure, and resilient infrastructure that supports both customer-facing and internal AI workloads.
This role is ideal for someone who has successfully built and operated AI/ML platforms serving external users, understands the challenges of distributed systems at scale, and enjoys driving technical direction across engineering organizations. Required Skills & Experience
- 10+ years of professional software engineering and infrastructure engineering experience
- Proven expertise designing and scaling cloud-native distributed systems in production environments
- Strong background leading technical architecture decisions for large-scale platforms
- Extensive experience building and operating AI/ML infrastructure as a customer-facing product
- Hands-on experience deploying and supporting LLM-based applications in production
- Deep knowledge of Retrieval-Augmented Generation (RAG), prompts, embeddings, and model lifecycle management
- Advanced programming skills in Python and TypeScript
- Experience with model deployment, versioning, and model-serving platforms
- Strong understanding of API architecture, REST services, and OpenAPI specifications
- AWS expertise and experience working with containerized environments such as Docker
- Experience with Infrastructure as Code tools, including CloudFormation or CDK
- Knowledge of observability, monitoring, alerting, tracing, and SLI/SLO/SLA practices
- Experience implementing security controls for multi-tenant environments, including PII and PHI protection
- Ability to mentor engineers and influence architecture across multiple teams
- Familiarity with modern LLM orchestration frameworks
- Experience supporting agent-based AI systems in production
- Knowledge of model serving optimization, inference tuning, and cost management
- Experience with multimodal AI solutions involving image or scientific datasets
- Background in model optimization techniques such as quantization or distillation
- Experience working in regulated industries with compliance requirements
- Exposure to life sciences, healthcare, laboratory systems, or scientific data platforms
- Understanding of AI governance, evaluation frameworks, and quality monitoring
- Lead the design and evolution of the organization's AI and machine learning platform
- Define architecture standards for model serving, agent execution, and scalable AI workloads
- Manage model lifecycle processes including deployment, versioning, promotion, rollback, and governance
- Build infrastructure supporting both real-time and batch AI processing
- Design secure, multi-tenant AI environments with strong data isolation controls
- Develop evaluation frameworks, testing pipelines, and release gates for AI systems
- Establish observability, monitoring, and operational excellence standards
- Drive platform reliability, scalability, and cost-efficiency initiatives
- Partner with engineering, security, and data teams to deliver enterprise-grade AI solutions
- Lead design reviews and provide technical mentorship to engineering teams
- Evaluate emerging AI technologies and make strategic build-versus-buy recommendations
- Contribute to infrastructure automation, CI/CD improvements, and deployment practices
- Competitive base salary plus potential bonus eligibility
- Fully remote opportunity for candidates located in Massachusetts
- Opportunity to influence the architecture of a high-impact AI platform
- Leadership role with significant technical ownership and decision-making authority
- Medical Insurance
- Dental Benefits
- Vision Benefits
- Unlimited Paid Time Off (PTO)
- 401(k)
- Life Insurance
- Long-Term Disability Coverage
- Short-Term Disability Coverage
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- WO

Mid / Senior Software Development Engineer - ML Ops (US Federal) with Security ClearanceRecently posted
Workday, Inc. · Reston, VA · Hybrid · Posted 20 Nov 2026 🇺🇸
DockerGCPMicroservices+13Technology$163.8k/yr - IS
Python AI/ML EngineerRecently posted
IT Solutions · Malvern, PA · Hybrid · Posted 20 Nov 2026 🇺🇸
FastAPIAWSPython+1TechnologySalary not listed - TA

Software Engineer / AI & Machine Learning Engineer with Security ClearanceRecently posted
TalentOps · Chantilly, VA · Hybrid · Posted 20 Nov 2026 🇺🇸
HTMLApacheMachine Learning+1TechnologySalary not listed - TE
AI/ML Engineer - Denver, CO, Phoenix, AZ, St. Louis, MO, Nashville, TN, Kansas City, KS.Recently posted
TechniPros, LLC · Denver, CO · Hybrid · Posted 20 Nov 2026 🇺🇸
DockerFastAPISQL+13TechnologySalary not listed - QU
AI/ML Engineer – Vertex AI - Denver, CO, Phoenix, AZ, St. Louis, MO, Nashville, TN, Kansas City, KS.Recently posted
QTech US Inc · Denver, CO · Hybrid · Posted 20 Nov 2026 🇺🇸
DockerFastAPISQL+13TechnologySalary not listed - EX
Senior Machine Learning Engineer- (Generative AI)Recently posted
Excelraise LLC · Raleigh, NC · Hybrid · Posted 20 Nov 2026 🇺🇸
SAFeDynamoDBFastAPI+20TechnologySalary not listed - PS
Senior Machine Learning EngineerRecently posted
Precision System Design Inc. · Cleveland, OH · Remote · Posted 20 Nov 2026 🇺🇸
DockerSQLAWS+8TechnologySalary not listed - TE
AI/ML Engineer - Chicago, IL, Minneapolis, MN, Detroit, MI, Madison, WI, Columbus, OH.Recently posted
TechniPros, LLC · Chicago, IL · Hybrid · Posted 20 Nov 2026 🇺🇸
DockerSQLGit+21TechnologySalary not listed - RI

Engineering Intern - ML Compilers (Spring 2027 Co-op)
Rivian · Palo Alto, CA · On-site 🇺🇸
RecruitingSpringBackground Checks+7$45 - $51/hr - NG

Fulltime Job -Machine Learning Engineer-Irving, TXRecently posted
Newt Global · Irving, TX · Hybrid · Posted 20 Nov 2026 🇺🇸
Stakeholder ManagementMachine LearningTechnologySalary not listed - BA

AI/ML EngineerRecently posted
Booz Allen Hamilton · San Diego, CA · On-site · Posted 19 Nov 2026 🇺🇸
DockerAWSScikit-learn+11Technology$77.6k - $176k/yr - IT

AI/ML EngineerRecently posted
IT Trailblazers, LLC. · Sunnyvale, CA · Hybrid · Posted 19 Nov 2026 🇺🇸
C++PyTorchPython+2TechnologySalary not listed
