Why this role stands out
Accelerate your career at the forefront of AI innovation by building the high-performance distributed infrastructure that powers Luma’s cutting-edge multimodal models. This hybrid role is perfect for a seasoned engineer with deep expertise in PyTorch and CUDA who thrives on solving complex challenges in large-scale cluster optimization. Apply today to make a massive impact on the future of foundation models while working with a world-class team.
Quick overview
Job description
You'll build the distributed systems that train Luma's large-scale multimodal models across thousands of GPUs, so researchers can focus on innovation on top of reliable, efficient, scalable infrastructure.
This is hard PyTorch, CUDA, and distributed-systems work — advanced parallelism, training stability, and utilization across massive clusters. It fits an engineer who's solved real problems training foundation models at scale. If you haven't worked at the level of FSDP and multi-node training, this is the wrong depth.
What You'll Own
Design, implement, and optimize efficient distributed training systems for models across thousands of GPUs.
Research and implement advanced parallelization (FSDP, Tensor Parallel, Pipeline Parallel, Expert Parallel).
Build monitoring, visualization, and debugging tools for large-scale training runs.
Optimize training stability, convergence, and resource utilization across massive clusters.
First 90 Days
One way the first 90 could unfold.
Days 1–30 — Immerse & Diagnose: Learn the current training stack and where stability and utilization hurt at scale.
Days 30–60 — Ship & Validate: Land a parallelization or stability improvement that measurably helps a real training run.
Days 60–90 — Scale & Systemize: Build the monitoring and tooling that keeps large runs reliable and efficient.
What You Bring
Extensive distributed PyTorch training and parallelisms in foundation-model training.
Deep understanding of GPU clusters, networking, and storage systems.
Familiarity with communication libraries (NCCL, MPI) and distributed-system optimization.
Nice to Have
Strong Linux systems administration and scripting.
Experience managing training runs across 100+ GPUs.
Experience with containerization, orchestration, and cloud infrastructure.
About Luma: Luma's mission is to build unified general intelligence that can generate, understand, and operate in the physical world. We believe multimodality is critical for intelligence — the next step beyond language models comes from vision. Luma is an equal opportunity employer.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your CV get past this employer's screening? Check your CV against this job, free
Similar jobs
- BI

Scientist, Protein EngineeringRecently posted Auto Apply
biomodal · Cambridge · Hybrid · Posted 16 Nov 2026 🇬🇧
EnzymePythonStructural Analysis+2EngineeringSalary not listed - BI

Associate ScientistRecently posted Auto Apply
biomodal · Cambridge · Hybrid · Posted 16 Nov 2026 🇬🇧
Salary not listed - LC

Research Consultant (Real Assets)Recently posted Auto Apply
Lane Clark & Peacock · London · Hybrid · Posted 20 Nov 2026 🇬🇧
Microsoft ExcelDue DiligenceProject ManagementSalary not listed - RI

QEC Researcher - Applied QECRecently posted Auto Apply
Riverlane · Cambridge · Hybrid · Posted 20 Nov 2026 🇬🇧
GDPRPythonQuantum Computing£70k - £108k/yr - EI
Scientist, Enzymology - Plant Biology InstituteRecently posted Auto Apply
Ellison Institute of Technology · Oxford · On-site · Posted 20 Nov 2026 🇬🇧
EnzymeRoboticsData AnalysisSalary not listed - E1

Precision Photonics Scientist - Magnetic Field SensingRecently posted Auto Apply
E184 · Watford · On-site · Posted 18 Nov 2026 🇬🇧
EchoSalary not listed - MG
Quant Researcher - Macro ; Futures / FXRecently posted Auto Apply
Man Group · London · On-site · Posted 20 Nov 2026 🇬🇧
PythonSalary not listed - NB
Junior Quantitative Researcher, Commodities and Cross AssetRecently posted Auto Apply
Neuberger Berman · London · On-site · Posted 17 Nov 2026 🇬🇧
Due DiligenceFixed IncomePythonSalary not listed - PH

Research Scientist - Large Geometry ModelsRecently posted Auto Apply
PhysicsX · London · Hybrid · Posted 17 Nov 2026 🇬🇧
CUDAComplianceDeep Learning+2Salary not listed - HI

Harness Research Engineer | 36labs Auto Apply
Hirehire · London · Hybrid · Posted 10 Nov 2026 🇬🇧
LLMPythonTypeScriptEngineeringSalary not listed - RE

Director, Antibody DiscoveryRecently posted Auto Apply
Relationrx · London · Hybrid · Posted 16 Nov 2026 🇬🇧
RecruitingOnboardingIntellectual Property+3Salary not listed - L5

Research ManagerRecently posted Auto Apply
Legal 500 · Leeds · Hybrid · Posted 16 Nov 2026 🇬🇧
Stakeholder ManagementMarket ResearchBusiness DevelopmentSalary not listed
