Why this role stands out
This role offers a unique opportunity to directly impact the performance and stability of cutting-edge AI infrastructure, with direct support from AMD engineers and significant growth potential. You'll thrive here if you are a proactive hardware operations professional with a passion for ensuring robust system health and reliability in a dynamic, on-site environment. Apply now to be a critical part of a rapidly scaling AI company!
Quick overview
Job description
Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.
Role Overview
We are looking for a dedicated Hardware Operations Engineer to own the physical health and foundational infrastructure of our GPU clusters. You will be the primary custodian of our compute hardware, responsible for everything from data center vendor coordination up to the base Linux OS layer. You will ensure our research and product teams have a stable, secure, and fully operational physical environment to run their demanding compute workloads on.
Key Responsibilities
System Health & Hardware Reliability
On-Call Response: Serve as the primary point of contact for physical system outages, hardware failures, and network interruptions to minimize downtime.
Cluster Monitoring: Proactively monitor hardware health, including GPU thermals, power draw, and physical system loads, catching anomalies before they impact active workloads.
Vendor Liaison: Work closely with data center facility staff and third-party hardware vendors to coordinate RMA processes, physical repairs, part replacements, and routine maintenance.
Hardware Deployment: Rack, cable, and lead the physical bring-up of new GPU nodes, ensuring power and network connectivity are fully integrated into the existing cluster.
Linux & Network Administration
OS Management: Install, patch, and maintain Linux operating systems (Ubuntu/CentOS/RHEL) across the cluster bare-metal servers.
Security & Access: Configure and maintain edge and internal networking, including firewalls, VPNs, and strict SSH access controls to secure our infrastructure.
Identity & Storage Management: Administer LDAP/Active Directory for centralized user authentication and ensure network storage systems (NFS/GPFS/Lustre) are reliably mounted and properly permissioned.
Qualifications
Must-Haves:
3+ years of experience in Linux Systems Administration (deep knowledge of boot processes, systemd, disk management, etc.).
Strong background in server hardware troubleshooting, specifically within high-density environments (power, cooling, PCIe topologies).
Experience managing networking security (VPNs, iptables/firewalld, VLANs) and directory services (LDAP/FreeIPA/Active Directory).
Proficiency in Bash scripting for essential system automation.
Nice-to-Haves:
Experience using configuration management tools like Ansible, SaltStack, or Terraform for OS provisioning.
Familiarity with data center operations, cooling requirements for high-TDP accelerators (like NVIDIA B200 or AMD MI355x).
Benefits include
Medical, dental, and vision insurance
401k plan
Daily lunch, snacks, and beverages
Flexible time off
Competitive salary and equity
Equal opportunity
Sciforium is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
Similar jobs
- OP
Lead Engineer, Pricing & Decision SystemsNew Auto Apply
One Park Financial · Salt Lake City, Utah · Hybrid 🇺🇸
DockerDynamoDBFastAPI+20EngineeringSalary not listedYesterday - OP
Lead Engineer, Pricing & Decision SystemsNew Auto Apply
One Park Financial · Plano, Texas · Hybrid 🇺🇸
DockerDynamoDBFastAPI+20EngineeringSalary not listedYesterday - OP
Lead Engineer, Pricing & Decision SystemsNew Auto Apply
One Park Financial · Miami, Florida · Hybrid 🇺🇸
DockerDynamoDBFastAPI+20EngineeringSalary not listedYesterday - SH

Senior Software EngineerNew Auto Apply
Sharetec · United States · Remote 🇺🇸
OnboardingDockerMongoDB+26TechnologySalary not listedYesterday - DE

Embedded Systems Engineer, RoboticsNew Auto Apply
Dexmate · Fremont Office · On-site 🇺🇸
Embedded SystemsRoboticsAltium+7TechnologySalary not listed9 hours ago - CL

Member of Technical StaffNew Auto Apply
Clera · United States · On-site 🇺🇸
LLMPythonTypeScriptSalary not listed9 hours ago - CL

Senior Integration EngineerNew Auto Apply
Clera · New York · Remote 🇺🇸
FastAPISQLAWS+10TechnologySalary not listed10 hours ago - RE

Software Engineer, Ad SignalsNew Auto Apply
Reddit · Remote - United States · Remote 🇺🇸
SQLMental HealthSystem DesignTechnologySalary not listed10 hours ago - PE

Member of Technical Staff (Software Engineer, Training Infrastructure)New Auto Apply
Perplexity · San Francisco · Hybrid 🇺🇸
RustAWSC+++2TechnologySalary not listed12 hours ago - PE

Member of Technical Staff (AI Software Engineer, Agents)New Auto Apply
Perplexity · San Francisco · Hybrid 🇺🇸
RustPlaywrightPython+1TechnologySalary not listed12 hours ago - VT

Senior Software Engineer, TVisionNew Auto Apply
Viant Technology · Cambridge · Hybrid 🇺🇸
AWSFlinkComputer Vision+3Technology$120k - $150k/yrYesterday - TA

Forward Deployed Engineer, Post-TrainingNew Auto Apply
Together AI · San Francisco · Hybrid 🇺🇸
Customer SuccessLLMPython+3Engineering$270k - $300k/yrYesterday
