Haystack
← Back to Jobs
Technology
CO

Senior Machine Learning Engineer

Compunnel Inc.Raleigh, NC🇺🇸United StatesPosted 13 Sept 2026

Why This Role Stands Out

This Senior Machine Learning Engineer role offers an exciting opportunity to shape the future of legal technology by designing and deploying cutting-edge generative AI solutions, with a hybrid work model providing excellent flexibility. You'll thrive here if you possess strong technical leadership skills in LLMs, RAG, and MLOps, and are eager to collaborate with cross-functional teams to drive innovation and achieve significant career growth. Apply now to leverage your expertise in a dynamic and impactful environment!

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
Raleigh, NC, United States
Posted
8 hours ago
MLOpsMachine LearningNLPGenerative AILLMPython

Job Description

Key Responsibilities
Design, build, and deploy scalable machine learning and generative AI solutions for legal technology products. Develop and optimize NLP, LLM, and Retrieval-Augmented Generation (RAG) applications for production environments. Engineer agentic AI workflows and multi-step reasoning systems to automate complex legal processes. Implement and improve retrieval systems, including vector databases, semantic search, lexical search, and hybrid search architectures. Build and maintain ML pipelines, APIs, model serving infrastructure, and cloud-based AI platforms.

Establish MLOps best practices for model deployment, monitoring, observability, versioning, and lifecycle management. Evaluate and optimize model performance, latency, scalability, and cost efficiency across AI applications. Partner with product managers, legal subject matter experts, data scientists, and software engineers to deliver business-focused AI solutions. Troubleshoot production ML systems, identify performance bottlenecks, and implement continuous improvements.

Provide technical leadership and mentorship on machine learning engineering, LLM architecture, and AI platform best practices.

Required Qualifications
7+ years of experience
Bachelors Degree

Skills
Machine Learning Engineering
Generative AI Solutions
Python Programming
Large Language Models (LLMs)
Retrieval-Augmented Generation (RAG) Systems
Natural Language Processing (NLP)
Agentic AI Workflows
Retrieval Systems
ML Pipelines
Cloud-based AI Platforms
Unstructured Data Processing
Prompt Engineering
Technical Leadership
Cross-functional Collaboration
MLOps Best Practices
Production System Troubleshooting
Product Development Lifecycle

Schedule
Start date: 2026-08-27

Similar jobs