Back to Jobs
Recently postedTechnology

Research Engineer: AI Inference & Latency

Mistrallondon, england🇬🇧United Kingdom

Quick overview

SeniorityMid Senior
Work modeHybrid
Locationlondon, england, United Kingdom
LLM

Job description

Mistral is seeking a Research Engineer for the Latency & Throughput team to push the frontier of LLM inference. You will explore speculative decoding, quantization, and KV compression, turning research ideas into production-ready improvements within our vLLM-based serving stack.

You will work closely with inference engineers and researchers, running rigorous experiments, and contributing to design choices that balance latency gains with model quality.

#J-18808-Ljbffr

Similar jobs