Why this role stands out
This role offers a unique opportunity to build and scale the core infrastructure of an innovative AI cloud marketplace, directly impacting the democratization of AI. You'll thrive here if you possess deep expertise in bare-metal provisioning and GPU orchestration, eager to work at the forefront of cloud technology and contribute to significant cost savings for AI developers. Apply now to shape the future of AI accessibility!
Quick overview
Job description
Who We Are
Join us in putting the world’s compute behind the people building what comes next.
At Hyperbolic, we’re making global AI compute liquid. We bring fragmented, heterogeneous GPU capacity together into one unified, productive platform, making it easier to access, sell, resell, manage, and orchestrate the resources that power AI. For neocloud, we turn GPU capacity into productive infrastructure that delivers lasting value and accelerate their time to market.
We believe bold ideas deserve the computing power to become reality. We’re building toward a future where compute flows as freely as electricity, available when and where it’s needed, so builders everywhere can turn their most ambitious ideas into breakthroughs.
We’re looking for curious, driven people who take ownership, challenge assumptions, and care deeply about what they build. If you’re energized by hard problems and want to help shape how the world accesses AI, we’d love to build with you.
About the Role
We're seeking a very senior Infrastructure Engineer to help build and scale Hyperbolic's GPU Cloud Marketplace, by building a multi-tenancy provisioning and virtualization solution. This is a foundational role where you'll be responsible for transforming raw GPUs from diverse global suppliers into a programmable, orchestrated pool that serves thousands of AI developers and researchers. You'll work at the cutting edge of cloud infrastructure, building the core orchestration layer that enables our platform to deliver up to 75% cost savings compared to traditional cloud providers.
Who You Are
Deep understanding of bare-metal provisioning and lifecycle management, including IPMI/Redfish, BMC-based remote management, PXE boot, and automated OS deployment workflows
Deep understanding of GPU scheduling and orchestration, including GPU type awareness, memory management, topology considerations, placement strategies for multi-GPU jobs, and fragmentation minimization
Strong infrastructure and DevOps engineering skills with proficiency in Terraform or Pulumi, CI/CD for infrastructure, secrets management, configuration management, and observability stack implementation
Experience with storage and data infrastructure for AI/ML workloads, including object storage, high-IOPS block storage, and distributed file systems for training data and checkpoints
Proficiency with API design and cloud-init for automated provisioning and configuration
Solid understanding of GPU architecture, CUDA, and GPU compute optimization
Highly collaborative team player with excellent communication skills across technical and non-technical stakeholders
Proven ability to work effectively with hardware vendors and vendor engineering teams to troubleshoot issues and optimize integrations
Experience building and scaling cloud infrastructure or distributed systems in production environments
Preferred Qualifications
Familiarity with high-performance networking technologies such as InfiniBand and RoCE (RDMA over Converged Ethernet)
Experience with distributed storage systems such as Ceph, Weka, or VAST Data
Hyperbolic is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- SP
Software Engineer, Super IntelligenceRecently posted Auto Apply
SpaceXSI · Palo Alto · Hybrid · Posted 16 Nov 2026 🇺🇸
RustTCP/IPC+++1Technology$140k - $225k/yr - AU

Sr. Robotic Software EngineerRecently posted Auto Apply
Aureliussystems · San Francisco · On-site · Posted 16 Nov 2026 🇺🇸
RoboticsC++Python+1TechnologySalary not listed - AU

Principal Robotic Software EngineerRecently posted Auto Apply
Aureliussystems · San Francisco · On-site · Posted 16 Nov 2026 🇺🇸
RustRoboticsC+++1TechnologySalary not listed - CL

Sr. Software Engineer - Enterprise Features & OrchestrationRecently posted Auto Apply
Clickhouse · Europe or US · Remote · Posted 16 Nov 2026 🇺🇸
GCPMongoDBAWS+12TechnologySalary not listed - PV

Sr. Forward Deployed Engineer (FDE)Recently posted Auto Apply
PVM, Inc. · Colorado Springs - ONSITE · Hybrid · Posted 16 Nov 2026 🇺🇸
EchoJavaPython+3EngineeringSalary not listed - TT
Founding Senior EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 16 Nov 2026 🇺🇸
LLMPythonTypeScript+1Engineering$175k - $225k/yr - TT
Robotics Software EngineerRecently posted Auto Apply
True Talent Solutions Partners · Watertown · On-site · Posted 16 Nov 2026 🇺🇸
DockerEmbedded SystemsRobotics+6Technology$130k - $180k/yr - TT
Forward Deployed Infrastructure EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 16 Nov 2026 🇺🇸
DockerGCPAWS+6Technology$200k - $300k/yr - TT
Senior/Staff Software EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 16 Nov 2026 🇺🇸
RustAWSERP+5Technology$180k - $270k/yr - TT
Senior Forward Deployed Engineer, OperateRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 16 Nov 2026 🇺🇸
GCPNext.jsAWS+15Engineering$170k - $205k/yr - TT
Senior Software Engineer, Distributed Systems (Core)Recently posted Auto Apply
True Talent Solutions Partners · Remote · Remote · Posted 16 Nov 2026 🇺🇸
DockerSQLFlink+2Technology$180k - $320k/yr - TT
Software Engineer, C++ SystemsRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 15 Nov 2026 🇺🇸
RustC++Kubernetes+1Technology$250k - $325k/yr
