Haystack
← Back to Jobs
Technology
SS

Senior Machine Learning Engineer (Inference & Deployment)-Exp 12+yrs

SSTech LLCUnited States🇺🇸United StatesPosted 27 Aug 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
United States
Posted
21 hours ago
FlinkMachine LearningGenerative AIGoogle CloudJavaKafka

Job Description

 

*Job Title:* Senior Machine Learning Engineer (Inference & Deployment)
*Client:* Yahoo
*Function:* Engineering
*Experience:* 10-15 Years
*Location:* United States - San Jose, CA
*Work Model:* Remote
*Skills:* Google Cloud Platform, Generative AI, Java

*Job Description:*

- Own deployment automation from model handoff to live serving on *Google Cloud Platform*, integrating models into *Java-based streaming pipelines*.
- Benchmark & evaluate new ML inference frameworks, conduct performance/quality testing, and model sampling to support researcher feedback.
- Monitor & debug real-world model behavior across full distributed stack.
- Partner closely with ML researchers to guide inference decisions.

*Must-Have Requirements:*

- 10+ years engineering exp with strong foundation in ML Inference, Deployment & Quality Testing
- Hands-on experience deploying models in cloud (Google Cloud Platform preferred)
- Exposure to Java / JVM-based systems
- Familiarity with Streaming Data Architectures (Kafka, Flink, Beam etc.)
- Experience in Hybrid Cloud + On-Prem environments
- Working knowledge of Distributed Systems
- Bachelor's / Master's in CS, CE, EE, Math or related

Similar jobs