Haystack
← Back to Jobs
Technology

Senior Machine Learning Engineer - Boston - Rag/Ai/LLM

Motion Recruitment Partners, LLCBoston, MA🇺🇸United StatesPosted 4 Aug 2026

Quick Overview

Work Type
Hybrid
Level
Mid Senior

Job Description

Job Description

A global provider of data-driven technology solutions is seeking a Senior Machine Learning Engineer to join its Boston-area team in a hybrid capacity. This engineer will guide the design of scalable artificial intelligence platforms and advanced agent-based systems used across a broad suite of enterprise products.

The position centers on developing modern AI capabilities for a complex professional-information environment. Key initiatives include intelligent research tools, retrieval-augmented generation systems, large language model applications, and production-ready autonomous workflows. You will also help set architectural direction, define engineering best practices, and improve the reliability and security of the broader AI ecosystem.

Core Qualifications

Deep knowledge of machine learning systems and autonomous agent design

Hands-on experience creating LLM applications and retrieval-augmented generation solutions

Practical experience working with vector search technologies and vector data stores

Familiarity with production ML operations, monitoring, and deployment practices

Strong Python development skills

Working knowledge of AWS infrastructure and Kubernetes environments

Preferred Background

Experience delivering software for legal technology, compliance, financial services, or another regulated domain

At least 12 years of software engineering experience, or 8 or more years combined with a PhD

Bachelor's degree or higher in computer science, engineering, data science, or a related discipline

Key Responsibilities

Day-to-Day Work

This is a highly hands-on engineering position

Create, productionize, and maintain sophisticated AI and ML capabilities for enterprise research applications

Architect and enhance distributed machine learning services and scalable platform components

Build agentic applications, semantic retrieval pipelines, and supporting orchestration frameworks

Partner with software, platform, and security teams to deliver dependable, secure, and high-performing AI systems

Compensation

Eligible for a performance-based bonus

Benefits include

Comprehensive medical coverage

Dental insurance

Vision insurance

Paid vacation and personal time

401(k) retirement plan with employer match, where offered

This position follows a hybrid schedule in Boston, Massachusetts.

Candidates must be authorized to work full-time in the United States both now and in the future.

Skills

AWS
Machine Learning
Kubernetes
LLM
Python

Similar jobs