Why this role stands out
As an Inference Engineer at Hyperbolic, you'll have the unique opportunity to build and own critical inference capabilities from the ground up, directly shaping the future of AI accessibility. This role is ideal for a skilled engineer eager to tackle complex challenges in distributed systems and model deployment, contributing to a company revolutionizing the AI cloud. Apply now to join a mission-driven team and make a significant impact on the global AI landscape.
Quick overview
Job description
Who We Are
Join us in putting the world’s compute behind the people building what comes next.
At Hyperbolic, we’re making global AI compute liquid. We bring fragmented, heterogeneous GPU capacity together into one unified, productive platform, making it easier to access, sell, resell, manage, and orchestrate the resources that power AI. For neocloud, we turn GPU capacity into productive infrastructure that delivers lasting value and accelerate their time to market.
We believe bold ideas deserve the computing power to become reality. We’re building toward a future where compute flows as freely as electricity, available when and where it’s needed, so builders everywhere can turn their most ambitious ideas into breakthroughs.
We’re looking for curious, driven people who take ownership, challenge assumptions, and care deeply about what they build. If you’re energized by hard problems and want to help shape how the world accesses AI, we’d love to build with you.
About the Role
We're looking for an Inference Engineer to build inference capabilities on top of Forge, our unified control plane, so customers can consume model tokens without managing GPUs and our NeoCloud partners get a full-stack path to their own token-factory offering. You'll own how models get deployed and served across clusters distributed around the world, on heterogeneous hardware.
Deployment comes first: serving models on Forge and our Kubernetes offering, evaluating inference frameworks, and standing up the monitoring, gateways, and endpoints that make a deployment production-ready. From there the work expands into optimization, autoscaling, KV-cache orchestration, and customer inference debugging. This is the primary seat for inference at Hyperbolic \u2014 you'll build it end to end, with real influence over where the scope lands.
Who You Are
Strong general inference background with a broad, high-level command of the stack rather than a narrow specialty — you can reason about the whole path from request to token
Deep Kubernetes experience, including hands-on ability to operate clusters in production, not just deploy to them
Solid grasp of the concepts that govern inference performance: TTFT, disaggregated inference, speculative decoding, and KV cache and its inner workings
Familiarity with modern inference frameworks and serving engines, and the judgment to evaluate and select among them for a given workload
Working knowledge of NVIDIA Dynamo and how it fits into a distributed serving architecture
Experience setting up monitoring, gateways, and endpoints for production inference services
Proven ability to build a product end to end — you've taken something from nothing to serving real traffic
Strong self-initiative and comfort operating as the primary owner of an area with minimal direction
Generalist instincts: you're willing to pick up adjacent work when it's what the product needs
Preferred Qualifications
Experience spanning both inference deployment and inference optimization
Hands-on model optimization work — quantization, batching strategies, kernel-level tuning, or similar
Understanding of RDMA and high-performance networking as they apply to distributed serving
Experience deploying inference across heterogeneous accelerators
Background supporting customers directly on inference debugging and performance issues
Experience at a GPU cloud, inference provider, or AI infrastructure company
Hyperbolic is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- AU

Sr. ML Engineer, PerceptionRecently posted Auto Apply
Aureliussystems · San Francisco · On-site · Posted 16 Nov 2026 🇺🇸
RoboticsC++Forecasting+2TechnologySalary not listed - TT
Member of Technical Staff, ML SystemsRecently posted Auto Apply
True Talent Solutions Partners · Menlo Park · On-site · Posted 16 Nov 2026 🇺🇸
CUDADeep LearningLLM+1$180k - $260k/yr - TT
Member of Technical Staff, Applied MLRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 15 Nov 2026 🇺🇸
Continuous ImprovementLLMPython+1$175k - $350k/yr - TT
Senior AI/ML EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 15 Nov 2026 🇺🇸
LLMPythonRAGTechnology$180k - $275k/yr - TT
Computer Vision ML / Research EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 15 Nov 2026 🇺🇸
OpenCVRoboticsCUDA+3Technology$180k - $245k/yr - WE

Senior Staff Machine Learning Scientist, Assets Auto Apply
Webflow · United States · Remote 🇺🇸
CADComputer VisionDeep Learning+6TechnologySalary not listed - CI
AI/ML Engineer, Internal Platforms - REMOTERecently posted Auto Apply
CONFISA INTERNATIONAL GROUP · Pembroke Pines, FL · Remote · Posted 15 Nov 2026 🇺🇸
FastAPIGCPAWS+10TechnologySalary not listed - BF

Machine Learning Engineer - AI SafetyRecently posted Auto Apply
Black Forest Labs · San Francisco (United States) · On-site · Posted 15 Nov 2026 🇺🇸
Generative AIRAGTechnology$220k - $280k/yr - TT
Founding ML Research EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 15 Nov 2026 🇺🇸
Computer VisionPyTorchPython+1$180k - $230k/yr - TT
Senior Data & Machine Learning EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York City · On-site · Posted 15 Nov 2026 🇺🇸
SQLETLdbt+1Technology$200k - $300k/yr - TI

Senior Research Engineer, Computer Vision Auto Apply
Tutor Intelligence · Watertown · Hybrid · Posted 7 Nov 2026 🇺🇸
OpenCVRoboticsC+++2TechnologySalary not listed - TI

Machine Learning Engineer, Robotics Auto Apply
Tutor Intelligence · Watertown · Hybrid · Posted 2 Nov 2026 🇺🇸
RoboticsComputer VisionDeep Learning+3TechnologySalary not listed
