Why this role stands out
This role offers a fantastic opportunity to shape cutting-edge on-prem AI infrastructure, developing your expertise in a cloud-like environment. You'll thrive here if you have a strong foundation in IaC, containerization, and datacenter operations, and are eager to contribute to a growing team that values best practices. Apply now to build the future of AI infrastructure!
Quick overview
Job description
- Design, build, and operate on-prem infrastructure that behaves like a cloud environment for internal teams, including AI/ML workloads
- Own datacenter and infrastructure operations: compute, storage, networking, and the automation layered on top
- Build and maintain Infrastructure-as-Code using Terraform (Terragrunt), Ansible, etc.
- Deploy, secure, and operate our HashiCorp stack (Vault, Boundary) alongside identity/access via Keycloak
- Build and maintain observability with Prometheus, Grafana, and Alertmanager
- Deploy and manage containerized workloads via Docker and Kubernetes
- Design and maintain networking infrastructure: VLANs, routing, firewall rules, and load balancers
- Write scripts/tools (and contribute code where useful) to automate operational toil
- Provide general datacenter support for customers colocated in the HostMax datacenter — things like cabling, hardware swaps, rack/stack work, and basic troubleshooting
- Participate in business-hours (M-F) on-call rotation for customer and infrastructure support
- Participate in an SDLC/Scrum-based workflow, using Jira and Confluence for planning and documentation
- Help define standards, runbooks, and best practices as the team grows
- Development and deployment of AI infrastructure workloads on-prem (GPU scheduling, model serving infra, self-hosted AI tooling, etc.)
- Solid experience with Infrastructure-as-Code and Configuration-as-Code
- Real-world on-prem/datacenter operations experience — this is explicitly not a cloud-native (AWS/GCP/Azure) role, though the environment is designed to feel cloud-like
- Working knowledge of networking fundamentals: VLANs, routing, firewalls, and load balancers
- Hands-on experience with containerization and orchestration (Docker, Kubernetes)
- Proficiency with Git and standard version control workflows
- Development/scripting skills sufficient to build internal tooling and automation (not just run existing playbooks)
- Comfort with hands-on datacenter/hardware work (cabling, rack/stack, hardware troubleshooting) in addition to infra engineering
The salary range offered for this position is between $1450,000 to $170,000 annually. The final compensation will be determined based on the candidate's qualifications and experience level.
- Medical Insurance
- Dental Insurance
- Vision Insurance
- 401(k)
- Flexible spending account
- Commuter benefits
- Disability insurance
We also have a perfect location for all types of commuters: AMAX is located right between I-680 and I-880. Warm Springs/South Fremont BART station and bus stops are within a 10-minute walking distance. 5 grocery stores, 6+ coffee/tea places, and numerous restaurants within 1 mile. Feel free to try the delicious fusions or grab your daily groceries after work!
About AMAX
Established in 1979, AMAX is a globally recognized leader in GPU-accelerated IT infrastructure, specializing in transforming standard IT systems into advanced, high-performance computing solutions. Catering to industries such as AI, cloud computing, autonomous vehicles, and high-performance computing, AMAX has set benchmarks in innovation, including pioneering liquid-cooled HPC systems for the semiconductor industry. With a global footprint spanning North America, Europe, and Asia, AMAX offers end-to-end services from design and manufacturing to deployment. Committed to addressing the growing demands of AI, AMAX delivers advanced solutions that help organizations achieve their technology goal and drive progress on a global scale.
Join Us
Become part of a diverse and inclusive team that values your technical expertise and innovative thinking. Together, we’ll push the boundaries of what’s possible in the hardware industry.
AMAX is proud to be an equal-opportunity employer. We welcome all applicants and provide equal employment opportunities regardless of age, race, gender, or other legally protected characteristics.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- ME

Tech Lead, Applied AI - Search Auto Apply
Mercor · San Francisco · On-site 🇺🇸
RecruitingConcreteLLM+1Salary not listed - TT
Founding AI EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 11 Nov 2026 🇺🇸
Next.jsLLMPlaywright+2Technology$216k - $250k/yr - MA

Privacy Research Engineer, AIRecently posted Auto Apply
Microsoft AI · Redmond · Hybrid · Posted 11 Nov 2026 🇺🇸
GDPRMachine LearningEngineering$142.8k - $274.8k/yr - GA
AI Implementation Specialist (2-Year Position)Recently posted Auto Apply
Gordon and Betty Moore Foundation · Palo Alto · Hybrid · Posted 12 Nov 2026 🇺🇸
Microsoft OfficeDue DiligenceGenerative AI+5Technology$100k/yr - C&

Director of Enterprise AI & Automation SolutionsRecently posted Auto Apply
Crowell & Moring · New York · Hybrid · Posted 11 Nov 2026 🇺🇸
ArbitrationComplianceDiversity & Inclusion+8$235k - $340k/yr - SC

AI ArchitectRecently posted Auto Apply
Schneidergis · Remote · Remote · Posted 11 Nov 2026 🇺🇸
C#.NETGIS+5TechnologySalary not listed - EX
Technology Specialist - AI AmbassadorRecently posted Auto Apply
Expeditors · Salt Lake City, UT · On-site · Posted 11 Nov 2026 🇺🇸
Microsoft ExcelProcess ImprovementSupply Chain Management+1Logistics$28 - $32/hr - SE
Assoc AI Engineering (Cloud Security Automation) InternRecently posted Auto Apply
ServiceNow · Santa Clara, CALIFORNIA · On-site · Posted 12 Nov 2026 🇺🇸
Due DiligenceServiceNowTechnologySalary not listed - MI
Senior AI Engineer (Python)Recently posted Auto Apply
Miratech · United States · Remote · Posted 10 Nov 2026 🇺🇸
Stakeholder ManagementGCPAWS+8TechnologySalary not listed - BH
Forward Deployed Engineer, AI & AutomationRecently posted Auto Apply
Bask Health · United States · Remote · Posted 12 Nov 2026 🇺🇸
OnboardingDrizzleNext.js+17Salary not listed - BH
Forward Deployed Engineer, AI SolutionsRecently posted Auto Apply
Bask Health · United States · Remote · Posted 12 Nov 2026 🇺🇸
DrizzleNext.jsSQL+17Salary not listed - BH
Senior Forward Deployed Engineer, AI & AutomationRecently posted Auto Apply
Bask Health · United States · Remote · Posted 11 Nov 2026 🇺🇸
OnboardingDrizzleNext.js+17Salary not listed