Machine Learning Engineer - GPU Performance & Low-Latency Inference
Quick overview
Job description
We're partnering with a leading global trading firm to hire a Machine Learning Engineer to make ML models run as fast as possible. You'll work close to the hardware, squeezing latency out of real-time inference and speeding up training, in an environment where microseconds matter.
What you'll do
- Build and optimize low-latency inference pipelines that deliver real-time predictions in production
- Profile and optimize ML workloads at the device level: memory, compute, kernels and compilers
- Write and tune custom GPU code (CUDA, Triton or equivalent) where libraries fall short
- Apply and validate low-precision techniques (FP8/INT8, quantization), knowing which optimizations stay bit-exact,
- Optimize batching, KV caching and serving paths for latency-critical workloads.
- Extend the internals of PyTorch and inference frameworks to raise performance on specific workloads
What you'll bring
- 3+ years in machine learning, focused on inference or GPU performance
- Hands-on experience optimizing ML at the GPU level: CUDA, Triton, C++, TensorRT or similar
- Experience with profiling tools (Nsight, torch.profiler) and reasoning about memory bandwidth, latency and throughput
- A strong grasp of modern ML architectures, attention in particular, and how they map onto hardware
- Production-quality Python (C++ a strong plus), with testing discipline and ownership of the systems you ship
- A habit of measuring before optimizing, and the judgment to know when to build versus buy
Nice to have
- Experience building real-time, low-latency prediction systems in high-performance environments
- Experience with numerics: mixed precision, quantization and correctness at scale
- Contributions to open-source projects such as PyTorch, vLLM, Triton or FlashAttention
No trading experience is required. What matters is deep, hands-on performance engineering and a drive to make things faster.
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- TE
Machine Learning EngineerRecently posted
TechDoQuest · Florham Park, New Jersey · Hybrid · Posted 21 Nov 2026 🇺🇸
GCPGoogle CloudPython+3TechnologySalary not listed - FP
Machine Learning Engineer - Distributed Training & Research InfrastructureRecently posted
Fintal Partners · New York · Hybrid · Posted 21 Nov 2026 🇺🇸
PyTorchPythonTensorFlow+2TechnologySalary not listed - CO

Sr. Staff ML Infra Engineer - Offline Infra & TrainingRecently posted Auto Apply
Coupang · Mountain View · Hybrid · Posted 21 Nov 2026 🇺🇸
GCPScalaAWS+12Salary not listed - PA

Robotics Machine Learning EngineerRecently posted Auto Apply
Pantograph · San Francisco · On-site · Posted 21 Nov 2026 🇺🇸
RoboticsTechnology$150k - $260k/yr - AS
ML EngineerRecently posted
Apex Systems · Cleveland, OH · Hybrid · Posted 19 Nov 2026 🇺🇸
MLOpsHugging FacePyTorch+5TechnologySalary not listed - AS

Sr Staff Machine Learning Engineer, Adobe Firefly ServicesRecently posted
Adobe Systems · Seattle, WA · Hybrid · Posted 20 Nov 2026 🇺🇸
MLOpsCUDAPyTorch+5Technology$238.7k - $345.6k/yr - BF
AI/ML Engineer/Data Scientist with Security ClearanceRecently posted
BlueWater Federal Solutions, Inc. · Montgomery, AL · Hybrid · Posted 20 Nov 2026 🇺🇸
NLPPythonMachine Learning+1TechnologySalary not listed - AE

Applied Machine Learning EngineerRecently posted
Aerospace Corporation · Chantilly, VA · On-site · Posted 21 Nov 2026 🇺🇸
DockerMicroservicesSQL+17Technology$110.4k - $193.5k/yr - PS
Senior Machine Learning EngineerRecently posted
Precision System Design Inc. · Cleveland, OH · Remote · Posted 20 Nov 2026 🇺🇸
DockerSQLAWS+8TechnologySalary not listed - BA

Data Scientist and AI/ML Engineer with Security ClearanceRecently posted
Booz Allen Hamilton · Fort Belvoir, VA · On-site · Posted 20 Nov 2026 🇺🇸
MySQLSQLGit+11Technology$99k - $225k/yr - CM

Senior Machine Learning Engineer - Secure AI LabRecently posted
Carnegie Mellon University · Pittsburgh, PA · On-site · Posted 20 Nov 2026 🇺🇸
ETLComputer VisionC+++5TechnologySalary not listed - RI

Engineering Intern - ML Compilers (Spring 2027 Co-op)Recently posted
Rivian · Palo Alto, CA · On-site · Posted 21 Nov 2026 🇺🇸
RecruitingSpringBackground Checks+8$45 - $51/hr