Quick overview
Job description
- Install GPU servers and GPUs; verify seating, airflow and serviceability.
- Identify and validate cables and transceivers across the compute, storage and management fabrics; confirm signal quality before handover.
- Confirm power and cooling parameters against the design, and escalate where the data hall will not support it.
- Configure BMC and out-of-band management; set up TPM where required.
- Apply and verify firmware across GPU baseboards, NICs, switches, DPUs and transceivers; interpret and act on fault detection output.
- Install and configure the control plane: NVIDIA Base Command Manager including high-availability head nodes, operating system and cluster components, Slurm with Enroot and Pyxis, GPU and DOCA drivers, container toolkit and NCLI.
- Set initial parameters for third-party storage and confirm throughput against the design.
- InfiniBand: provisioning, high availability, partition keys for multi-tenancy, quality of service, adaptive routing, and link and bandwidth monitoring through UFM.
- Or Spectrum-X Ethernet: RoCE, ECN and PFC configuration, quality of service, adaptive routing, telemetry.
- Troubleshoot with the standard tooling — ibdiagnet, iblinkinfo, ib_write_lat and ib_write_bw, ibping, What Just Happened, UFM health.
- Single-node stress and burn-in.
- HPL and single-node NCCL, including NVLink and NVLink Switch verification.
- ClusterKit node assessment to find the weak node before the customer does.
- NCCL east-west fabric bandwidth tests across the cluster.
- Sustained burn-in using NCCL, HPL and NeMo workloads.
- Storage throughput testing under realistic checkpoint load.
- Produce the acceptance report: what was tested, what it returned, what was remediated.
- Diagnose and replace failed GPUs, network cards, fans and power supplies.
- Tune storage and fabric where results fall short of specification.
- Hand over to the customer or operations team with documentation that matches what was actually built.
- 5–8 years in data centre infrastructure engineering, of which at least 2–3 years hands-on with NVIDIA GPU hardware. This matches NVIDIA's own stated prerequisite for its AI infrastructure certification.
- Delivered at least one multi-node GPU cluster build. Node count, GPU model, fabric type and the candidate's own scope must be stated, not implied.
- Comfortable on a customer site, under programme pressure, working to someone else's design and method of procedure.
- Linux systems fluency; scripting for repeatable build steps.
- NVIDIA-Certified Professional: AI Infrastructure (NCP-AII)
- NVIDIA-Certified Professional: AI Networking (NCP-AIN) for fabric-leaning candidates
- Remote-only or lab-only experience. This work happens on site.
- Data scientists, ML engineers and MLOps specialists.
- Pure network engineers with no server, GPU or firmware exposure, unless hired explicitly against the fabric specialism.
- Candidates who cannot name the clusters they built and what they personally did on them.
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- JC

Systems & DevOps Engineer (TS/SCI w/ Poly) with Security ClearanceRecently posted
JTEC Consulting, LLC · Tysons, VA · On-site · Posted 18 Nov 2026 🇺🇸
DockerGitScrum+10Technology$135k - $160k/yr - 3S

AI Lead Platform Engineer Generative AI Platform Operations - Need LOCAL!Recently posted
3Core Systems, Inc · Chicago, IL · On-site · Posted 18 Nov 2026 🇺🇸
Stakeholder ManagementMLOpsGenerative AI+4TechnologySalary not listed - VC

DevOps Engineer (Full-Time)Recently posted
Voto Consulting LLC · Chantilly, VA · Hybrid · Posted 18 Nov 2026 🇺🇸
DockerOAuthDNS+2TechnologySalary not listed - PT

Senior DevOps Engineer (Automation & Middleware)Recently posted
Prudent Technologies and Consulting · Oakland, CA · On-site · Posted 18 Nov 2026 🇺🇸
DockerShellGit+9TechnologySalary not listed - IT
Sre DevOps EngineerRecently posted
ISite Technologies Inc · Austin, TX · Hybrid · Posted 18 Nov 2026 🇺🇸
DockerRustShell+22TechnologySalary not listed - SY

Senior AWS Cloud Infrastructure & DevOps EngineerRecently posted
SysMind, LLC · Atlanta, GA · On-site · Posted 18 Nov 2026 🇺🇸
GitAWSGitLab CI+3TechnologySalary not listed - TE
DevOps Engineer with AWS Connect - W2 - Atlanta, GA - ContractRecently posted
TechVirtue LLC · Atlanta, GA · Hybrid · Posted 18 Nov 2026 🇺🇸
GitAWSTerraformTechnologySalary not listed - IS
AWS Infrastructure / Platform Engineer, mid-level (about 2–3 years)Recently posted
ISOFT · Columbus, OH · On-site · Posted 18 Nov 2026 🇺🇸
DockerAWSTerraform+5TechnologySalary not listed - LI

SAP Technical Lead – BTP, Incentive Management/T&Q & DevOpsRecently posted
LiveMindz · St. Louis, MO · On-site · Posted 18 Nov 2026 🇺🇸
SQLCI/CDTechnologySalary not listed - AS
Senior Platform Engineer
Apex Systems · Plano, TX · Hybrid · Posted 10 Nov 2026 🇺🇸
DockerActive DirectoryAnsible+10TechnologySalary not listed - NG

Staff Software Engineer - DevOpsRecently posted
Northrop Grumman · Indian Harbour Beach, Florida · Hybrid · Posted 18 Nov 2026 🇺🇸
SwiftGitAWS+19Technology$152.9k - $229.3k/yr - NG

Staff Software Engineer - DevOpsRecently posted
Northrop Grumman · Satellite Beach, Florida · Hybrid · Posted 18 Nov 2026 🇺🇸
SwiftGitAWS+19Technology$152.9k - $229.3k/yr