Quick overview
Job description
Your mission & challenges
You are the go-to expert for NEURA's GPU cluster infrastructure - a large-scale AWS HyperPod environment running cutting-edge GPU instances for foundation model training and customer fine-tuning workloads. You design the operational framework, build self-service tooling for ML teams, and work directly with AWS to influence the platform at the hyperscaler level.
Your focus is on cluster engineering and operations — not on ML research itself, but on making sure the people doing that research have rock-solid, efficient, and accessible infrastructure under them.
Setting up, configuring, and continuously evolving NEURA's HyperPod clusters, including HyperPod/Slurm and HyperPod/EKS orchestration models.
Designing and implementing strategies for cluster stability: node failure detection, automated job recovery, checkpoint coordination, and fault-tolerant multi-node training workflows.
Providing a workload priority management framework that allows multiple teams and use cases like foundation model pretraining, fine-tuning, customer workloads, to share cluster capacity efficiently and fairly.
Optimizing end-to-end GPU utilization: identifying and resolving bottlenecks across compute, GPU memory, EFA networking, and storage throughput.
Working directly and closely with the AWS HyperPod product and solutions engineering teams, escalating operational issues, sharing learnings from one of the platform's largest deployments, and placing concrete requirements on the roadmap.
Providing self-service tooling that allows ML researchers and engineers to launch, monitor, and manage training jobs independently, without requiring infrastructure intervention for routine operations.
Developing onboarding documentation, training materials, and internal workshops that enable users to operate efficiently, follow best practices, and understand cost implications of their workloads.
Infrastructure as Code is a given for you. Every cluster configuration, every operational change, every new environment is code first.
Owning the cost and capacity strategy: Spot instance management, Reserved Instance planning, Savings Plans, and ongoing commitment negotiations with AWS.
What we can look forward to
5+ years of experience in infrastructure or systems engineering, with a strong focus on GPU cluster or HPC operations.
Deep hands-on experience with AWS HyperPod and AWS instances; direct prior experience with HyperPod is a strong differentiator.
Solid understanding of both Slurm and Kubernetes as cluster orchestration layers, and the ability to evaluate their trade-offs for large-scale GPU workloads.
Practical knowledge of distributed training - you understand what affects throughput and how to debug it.
Experience building self-service tooling and operational documentation for technical end users.
You make complex infrastructure accessible, not just functional.
Strong understanding of cloud cost management at scale: Spot interruption handling, capacity reservations, cost attribution across teams and workloads.
Comfort working across organizational boundaries — your primary partners are ML researchers, but you'll also work closely with product, finance, and cloud vendor teams.
Strong English communication skills. German is a plus.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your CV get past this employer's screening? Check your CV against this job, free
Similar jobs
- RA

Robotics Application EngineerRecently posted Auto Apply
Rhoda Ai · Munich · On-site · Posted 20 Nov 2026 🇩🇪
RoboticsCADMechanical Design+2TechnologySalary not listed - UQ
Software Engineer (Compilers) (f/m/d)Recently posted Auto Apply
Universal Quantum · Hamburg · Hybrid · Posted 19 Nov 2026 🇩🇪
RustSQLGit+3TechnologySalary not listed - MO

Staff Software Engineer, OS IntegrationRecently posted Auto Apply
Mozilla · Remote Germany · Remote · Posted 18 Nov 2026 🇩🇪
HTMLAssemblyCSS+4TechnologySalary not listed - SN

Software Engineer - Dynamic TablesRecently posted Auto Apply
Snowflake · DE-Berlin-Trion Building · Hybrid · Posted 18 Nov 2026 🇩🇪
SQLSnowflakeTechnologySalary not listed - EN

Senior Software Engineer Auto Apply
Enfuce · Berlin · Remote 🇩🇪
OracleSQLSpring+6TechnologySalary not listed - FO

Senior Backend Software Engineer - ShipmentRecently posted Auto Apply
Forto · Berlin · Hybrid · Posted 18 Nov 2026 🇩🇪
GCPMicroservicesMongoDB+6TechnologySalary not listed - ST
Senior Radar Signal Processing Engineer (All Genders)Recently posted Auto Apply
STARK · Munich · Hybrid · Posted 19 Nov 2026 🇩🇪
FPGAAgileEngineeringSalary not listed - SN

Software Engineer - Database SearchRecently posted Auto Apply
Snowflake · DE-Berlin-Trion Building · Hybrid · Posted 17 Nov 2026 🇩🇪
SQLSnowflakeC+++1TechnologySalary not listed - MO

AUTOSAR Embedded Software Engineer (m/w/d) Auto Apply
Mobileye · Koblenz · Hybrid 🇩🇪
GitGPTPython+2TechnologySalary not listed - RE
(Senior) Firmware Development Engineer (F/M/D)Recently posted Auto Apply
Renesas Electronics · Dresden · On-site · Posted 17 Nov 2026 🇩🇪
ScrumConfluenceJira+1EngineeringSalary not listed - AY
Software Engineer - Supply Data Solutions (all genders)Recently posted Auto Apply
ABOUT YOU SE & Co. KG · Hamburg, HH · Hybrid · Posted 16 Nov 2026 🇩🇪
SQLGitAWS+4Technology€60k - €70k/yr - N8

Forward Deployed Engineer - EMEARecently posted Auto Apply
N8n · Berlin Office · Remote · Posted 16 Nov 2026 🇩🇪
EngineeringSalary not listed
