Quick overview
Job description
Responsibilities
- Design, operate, and improve reliable infrastructure for AI training and inference workloads
- Own and automate operational workflows across one or more core areas: networking, compute allocation, storage, GPU/server configuration, or AI platforms
- Build monitoring, alerting, runbooks, and incident-response practices that make systems easier to operate
- Diagnose performance, capacity, and reliability issues across hardware, operating systems, networks, schedulers, and distributed workloads
- Partner closely with ML, research, and platform teams to translate workload needs into practical infrastructure improvements
- Improve provisioning, configuration management, testing, and deployment automation
- Help plan cluster growth, capacity allocation, upgrades, and lifecycle management
- Contribute to a thoughtful reliability culture through documentation, post-incident learning, and pragmatic engineering standards
Minimum Qualifications
- 4+ years of experience in site reliability engineering, infrastructure engineering, systems engineering, or a related production-operations role
- Strong hands-on expertise in at least one of the following:
- Networking, including firewalls, switching, routing, ASN/BGP configuration, or InfiniBand
- Cluster and systems allocation with Kubernetes, SLURM, MAAS, or similar platforms
- Distributed storage, particularly Ceph
- GPU and server administration, including CUDA drivers, firmware, BIOS, and hardware troubleshooting
- AI training or model-serving infrastructure
- Experience operating production systems with a focus on availability, performance, security, and automation
- Strong Linux administration and scripting skills
- A systematic approach to troubleshooting across multiple layers of a complex system
- Clear written and verbal communication skills, including the ability to work effectively with a distributed team
Preferred Qualifications
-
Experience supporting GPU-intensive AI or HPC environments
-
Experience with NVIDIA GPUs, CUDA, NCCL, and high-performance interconnects - Experience with InfiniBand, RDMA, RoCE, or 100Gb+ Ethernet
-
Familiarity with Kubernetes, SLURM, MAAS, Terraform, Ansible, or similar infrastructure tooling
-
Experience operating or tuning Ceph clusters
-
Familiarity with observability tooling such as Prometheus, Grafana, and centralized logging systems
-
Experience with hardware provisioning, firmware management, and bare-metal automation
-
Experience running large-scale distributed training or high-throughput inference workloads
-
Familiarity with cloud and hybrid infrastructure across AWS, GCP, or Azure
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- CA

Senior Site Reliability EngineerRecently posted Auto Apply
Camunda · Canada · Hybrid · Posted 16 Nov 2026 🇨🇦
GitAWSArgoCD+6Technology$149.8k - $241.5k/yr - CB

DevOps SpecialistRecently posted Auto Apply
Canadian Bank Note Company · Ottawa, ON · Remote · Posted 16 Nov 2026 🇨🇦
DockerMySQLPacker+25TechnologyC$86k - C$108k/yr - MA
Platform EngineerRecently posted Auto Apply
Matchgroup · Vancouver · Hybrid · Posted 14 Nov 2026 🇨🇦
DynamoDBSQLAWS+12TechnologyC$107.8k - C$128.3k/yr - SA

Senior Manager, Software Engineering - AI Developer Productivity (Dev Agents and SRE AI)Recently posted Auto Apply
Samsara · Remote - Canada · Remote · Posted 16 Nov 2026 🇨🇦
IoTTechnologyC$154.8k/yr - CA
Senior Site Reliability Engineer Auto Apply
Canonical_managed_posts · Toronto · Hybrid · Posted 10 Nov 2026 🇨🇦
OpenStackIoTPython+2TechnologySalary not listed - CA
Senior Site Reliability / Gitops Engineer Auto Apply
Canonical_managed_posts · Toronto · Hybrid · Posted 10 Nov 2026 🇨🇦
Capacity PlanningGrafanaIoT+5TechnologySalary not listed - SC
Devops SpecialistRecently posted Auto Apply
Scalian · Montreal · Hybrid · Posted 13 Nov 2026 🇨🇦
DockerGitBash+8TechnologySalary not listed - HI
Spécialiste DevOps / DevOps SpecialistRecently posted Auto Apply
Highdive · Montreal · Hybrid · Posted 13 Nov 2026 🇨🇦
DockerTeamCityGit+18TechnologySalary not listed - SO

DevOps EngineerRecently posted Auto Apply
Sovra · Montreal | Télécommande · Remote · Posted 13 Nov 2026 🇨🇦
Talent AcquisitionOnboardingGit+12TechnologySalary not listed - SO

Ingénieur(e) DevOpsRecently posted Auto Apply
Sovra · Montreal | Télécommande · Remote · Posted 13 Nov 2026 🇨🇦
GitAWSELK+8TechnologySalary not listed - DR

Senior Client Platform Engineer, Endpoint Platform & AutomationRecently posted Auto Apply
Dropbox · Remote - Canada: Select locations · Remote · Posted 12 Nov 2026 🇨🇦
SQLShellGit+5TechnologyC$125k - C$170k/yr - CO

Intermediate Software Developer, DevOpsRecently posted Auto Apply
Coveo · Montreal (Province of Quebec · Hybrid · Posted 12 Nov 2026 🇨🇦
SpinnakerGitGitHub Actions+4TechnologySalary not listed