Why this role stands out
This role offers an incredible opportunity to manage one of the world's largest AI training clusters, directly impacting cutting-edge anime AI development. You'll thrive here if you possess strong HPC and Linux sysadmin skills, enjoy complex infrastructure challenges, and are passionate about the intersection of technology and anime. Join a dynamic team and contribute to groundbreaking projects in a unique and exciting environment.
Quick overview
Job description

We’re looking for an experienced HPC infrastructure engineer to lead bringup, administration, and operations on is probably the largest anime AI training cluster in the world. You’ll serve as the bridge between our researchers and the bare GPU machines, helping to make sure that SLURM jobs are running, parallel filesystems are serving, network is transmitting, and that the anime models are training.
You may be a good fit if:
You love anime and the anime aesthetic.
This probably one of the only jobs in the world where you will get to combine your love of anime and large-scale GPU systems.
You’re familiar with the modern HPC software landscape
Once upon a time, our team could install SLURM on a few bare metal nodes and get away with it. Now the landscape has become unbelievable complex, with SLURM deploys through Slinky on K8s, provisioning through warewulf/MAAS/ansible, filesystems through WEKA/VAST/Ceph, VPN and access through tailscale, and monitoring via the Grafana/Prometheus stack. We’re looking for someone with relevant experience up and down the stack (and maybe a papercut or two to show for it!)
As well as the traditional sysadmin landscape
Bringing up and managing cluster still requires good old linux sysadmin skills, including wrangling ldap, triaging dmesg, and setting sticky bits on directories for misbehaving users and tools.
You're not afraid of physical computers
We’re building out edge datacenters and our CEO is still personally racking, stacking, and provisioning HGX-based nodes in our living room. Also his VLAN design sucks and he’s bad at fiber routing. Please send help.
And you're comfortable working on small, fast-paced teams.
We currently have a very tiny research team, and you’ll be directly helping some of the AI researchers in the world train the best anime image model in the world.
We also believe in the unmatched speed of in-person teams, and prefer on-site collaboration in either our primary research office in Tokyo (downtown Akihabara), or San Francisco (dogpatch!). Bay area is strongly preferred as we have physical hardware in the Bay Area. Visa sponsorships are available.

Similar jobs
- BJ
Member of Technical Staff, Machine Learning Auto Apply
Bjakcareer · United States · Remote 🇺🇸
PyTorchPythonMachine LearningTechnologySalary not listed - BJ
Applied Machine Learning Engineer Auto Apply
Bjakcareer · United States · Remote 🇺🇸
PyTorchPythonMachine LearningTechnologySalary not listed - TT
Member of Technical Staff, ML SystemsRecently posted Auto Apply
True Talent Solutions Partners · Menlo Park · On-site 🇺🇸
CUDADeep LearningLLM+1$180k - $260k/yr - MA

Compiler Engineer – MLIR / PyTorch Infrastructure Auto Apply
Mythic Ai.com · Palo Alto · Remote 🇺🇸
RoboticsC++PyTorch+2Salary not listed - MA

Compiler Engineer - Machine Learning Compiler Auto Apply
Mythic Ai.com · Palo Alto · Remote 🇺🇸
FPGARoboticsDeep Learning+7TechnologySalary not listed - TT
Member of Technical Staff, Reinforcement LearningRecently posted Auto Apply
True Talent Solutions Partners · Remote · Remote 🇺🇸
PyTorchPythonMachine Learning$250k - $400k/yr - TT
Founding ML Research EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site 🇺🇸
DockerComputer VisionAutonomous Driving+4$180k - $230k/yr - JO

Machine Learning Engineer, Perception Auto Apply
Jobgether · United States · Remote 🇺🇸
RoboticsComputer VisionData Privacy+6TechnologySalary not listed - JO

Lead Bioinformatics & Machine Learning Scientist (Epigenomics)Recently posted Auto Apply
Jobgether · United States · Remote 🇺🇸
Microsoft OfficeComplianceData Entry+3Technology$15 - $18/hr - LI
Data Science Level 3 (ML Ops Framework/Cyber Hunting), BS+10 yrs or MS+8 Auto Apply
Linkllc · Ft Meade · On-site 🇺🇸
TechnologySalary not listed - L8
Machine Learning Engineer Auto Apply
Leverdemo 8 · Irvine · Hybrid 🇺🇸
RecruitingTalent AcquisitionApplicant Tracking Systems+3TechnologySalary not listed - JO

Senior Machine Learning EngineerRecently posted Auto Apply
Jobgether · United States · Remote 🇺🇸
DockerGitOpenCV+13Technology$134.4k - $168k/yr
