Why This Role Stands Out
This hybrid role offers a unique opportunity to shape the foundational infrastructure for cutting-edge AI development, allowing you to build and optimize networks critical for large-scale GPU clusters. You'll thrive here if you're a driven mid-senior technical professional eager to contribute to a rapidly growing company backed by top-tier investors, making a tangible impact on the future of AI.
Quick Overview
Job Description
Own Your Intelligence
Prime Intellect is building the open superintelligence stack: the infrastructure frontier AI labs build internally, made available to every ambitious AI team.
Our platform, Lab, unifies compute, environments, evaluations, secure sandboxes, high-performance training, and deployment into one full-stack system for post-training at frontier scale - from SFT and RL to tool use, agent workflows, and continuously improving production models. We are building open frontier AI: open-source models trained end to end for long-horizon tasks like autonomous research, and the full-stack platform our own research team uses to build them. The next generation of AI companies, enterprises, and research teams do not just need more GPUs. They need the ability to turn their own workflows, tools, data, and feedback loops into superintelligence they own.
Prime Intellect has raised $150M in total funding from Founders Fund, Radical Ventures, NVIDIA, and exceptional AI, infrastructure, and enterprise operators, including Andrej Karpathy, Dwarkesh Patel, and leaders and founders from Ramp, Perplexity, Harvey, Mercor, Zapier, Datadog, Cognition, OpenAI, Thinking Machines, Together AI, SemiAnalysis, LangChain, Browserbase, Cloudflare, Sierra, Databricks, Airbnb, OpenRouter, Standard Intelligence, Fleet, Core Auto, and more. We are looking for people who want to build at the intersection of frontier research, real infrastructure, and go-to-market for a category that does not fully exist yet.
Role Impact
You'll design and operate the networks that connect large GPU clusters. Own the reliability and performance of training fabrics, storage networks, and management connectivity so distributed workloads can scale without the network becoming the bottleneck.
Core Technical Responsibilities
Design and deploy scalable datacenter network topologies for GPU training, inference, storage, and management traffic
Configure and operate high-performance Ethernet/RoCE and InfiniBand fabrics with clear standards for routing, redundancy, and capacity
Automate network provisioning, configuration validation, upgrades, and rollback procedures
Diagnose packet loss, congestion, link failures, and collective communication performance across hosts and switches
Benchmark end-to-end network performance with infrastructure and ML teams, translating workload needs into measurable acceptance criteria
Build monitoring for port health, errors, utilization, congestion, and fabric topology; improve incident response and runbooks
Partner with datacenter operators and hardware vendors on cabling, optics, deployment readiness, and failure resolution
Technical Requirements
Required Experience
3+ years of production datacenter networking experience
Strong understanding of Ethernet, TCP/IP, routing, switching, and redundant network design
Hands-on experience with high-performance GPU networking using InfiniBand or RoCE
Experience troubleshooting network problems across Linux hosts, NICs, switches, and physical links
Ability to automate network operations with Python, Ansible, or comparable tools
Infrastructure Skills
Leaf-spine architectures, BGP, ECMP, VLANs, and network segmentation
RDMA concepts and performance tuning; congestion control and lossless Ethernet considerations
Linux networking, NIC drivers and firmware, packet capture, and throughput/latency testing
Optics, transceivers, cable management, and link-level diagnostics
Safe change management, configuration versioning, telemetry, and alerting
Nice to Have
Experience operating 400G/800G networks or large multi-rack GPU clusters
NVIDIA Spectrum or Quantum networking experience
NCCL performance analysis and distributed training troubleshooting
EVPN/VXLAN, SONiC, or network source-of-truth systems
Experience with network simulation, automated validation, and capacity planning
Growth Opportunity
You'll work directly with customers pushing the boundaries of AI, from startups training foundation models to enterprises deploying massive inference infrastructure. You'll collaborate with our world-class engineering team while having direct impact on systems powering the next generation of AI breakthroughs.
We value expertise and customer obsession - if you're passionate about building reliable, high-performance GPU infrastructure and have a track record of successful large-scale deployments, we want to talk to you.
Apply now and join us in our mission to democratize access to planetary scale computing.
Compensation
Cash compensation range of $150,000–$300,000 plus equity incentives.
Similar jobs
- DU
Staff Software Engineer, Data - Experimentation
NewAuto ApplyDoorDash USA
California🇺🇸Hybrid16 hours agoSQLMachine LearningCompliance+1Technology - ZT
Software Engineer III
NewAuto ApplyZoomInfo Technologies LLC
Waltham🇺🇸HybridYesterdayMongoDBMySQLNestJS+13Technology - VS
Senior Software Engineer, Performance Engineering
NewAuto ApplyVeeam Software
San Jose🇺🇸HybridYesterdayAWSAzureDatabricks+10Technology - VE
Systems Integration Engineer
NewAuto ApplyVerifone
Atlanta🇺🇸HybridYesterdaySwiftComplianceConfluence+10Technology - TO
Software Engineer
NewAuto ApplyTomorrow.io
Golden🇺🇸HybridYesterdayDockerFlaskGCP+25Technology - ZS
Sr. Staff Software Development Engineer - Go Dataplane (SD-WAN)
NewAuto ApplyZscaler
Santa Clara🇺🇸$180k - $225k/yrHybridYesterdayAWSTCP/IPAgile+7Technology - SI
Staff Embedded Linux Software Engineer
NewAuto ApplySirenOpt
San Leandro🇺🇸$180k/yrHybridYesterdayDockerEmbedded SystemsFPGA+11Technology - PR
Senior Software Engineer - Knowledge Graph
NewAuto ApplyProve
New York🇺🇸HybridYesterdayDynamoDBGCPMicroservices+8Technology - AS
Software Engineering Internship (Jan - Apr 2027)
NewAuto ApplyAssorthealth
San Francisco🇺🇸On-siteYesterdayComplianceGenerative AIHIPAA+3Technology - PA
Principal Engineer
NewAuto ApplyPatientPoint
Cincinnati🇺🇸HybridYesterdayDockerDynamoDBMicroservices+24Technology - OH
Staff Software Engineer, Backend
NewAuto ApplyOscar Health
New York🇺🇸HybridYesterdayComplianceData PipelineRecruitingTechnology - OP
Software Engineer, Mobile Web — Dots
NewAuto ApplyOpenai
New York City🇺🇸HybridYesterdayMachine LearningBackground ChecksComplianceTechnology