Back to Jobs
Recently postedFull timeTechnology

Site Reliability Engineer

Weekday AIBengaluru, Karnataka🇮🇳India

Quick overview

SeniorityMid Senior
Employment typeFull Time
Work modeOn Site
LocationBengaluru, Karnataka, India
GCPAWSLoad BalancingTCP/IPCapacity PlanningDNSGrafanaHelmPrometheusRoot Cause AnalysisSchedulingTerraformTriageGenerative AIAzureKubernetesCI/CDLinux

Job description

This role is for one of Weekday’s clients
Salary range: Rs 1500000 - Rs 2500000 (ie INR 15 - 25 LPA)


Min Experience: 4+ years
Location: Bengaluru
JobType: full-time

We are seeking a skilled Site Reliability Engineer (SRE) to design, operate, and scale the high-performance infrastructure powering next-generation Generative AI (GenAI) platforms. The role will focus on ensuring the reliability, availability, scalability, and performance of production infrastructure, with particular emphasis on Kubernetes, GPU-enabled environments, and model-serving platforms.

The ideal candidate will have strong hands-on experience managing production Kubernetes clusters, troubleshooting complex infrastructure issues, automating operational workflows, and maintaining highly available cloud environments. This is an infrastructure-focused engineering position requiring expertise in SRE practices, DevOps, Linux, networking, observability, and infrastructure automation rather than application development.

You will take end-to-end ownership of critical production systems, drive reliability improvements, and build the infrastructure foundation required to support scalable AI workloads.

Key Responsibilities

1. Infrastructure Reliability & Platform Operations

  • Own the availability, reliability, scalability, and performance of production infrastructure and platform services.
  • Operate and maintain production Kubernetes clusters, ensuring stability and efficient resource utilization.
  • Manage cluster upgrades, networking, ingress configurations, autoscaling, workload scheduling, and resource optimization.
  • Monitor infrastructure health and proactively identify potential performance bottlenecks and reliability risks.
  • Troubleshoot complex production issues across nodes, networks, containers, and Kubernetes clusters.
  • Support high-performance GPU infrastructure and model-serving environments.

2. Production Support & Incident Management

  • Lead initial production issue analysis, incident triage, and troubleshooting.
  • Participate in on-call rotations and respond to critical infrastructure incidents.
  • Perform root cause analysis (RCA) and prepare post-incident reports and postmortems.
  • Identify recurring operational issues and implement preventive measures to improve system reliability.
  • Establish and improve incident response procedures, escalation processes, and operational best practices.
  • Drive deployment, rollback, and change-management practices to minimize production risks.

3. Kubernetes & Container Orchestration

  • Manage Kubernetes clusters across production environments, including upgrades, maintenance, and configuration.
  • Troubleshoot pod failures, node-level issues, networking problems, and cluster performance bottlenecks.
  • Configure and optimize ingress controllers, service networking, autoscaling, and workload scheduling.
  • Manage containerized workloads and deployment configurations using Helm.
  • Ensure efficient allocation and utilization of compute, memory, storage, and GPU resources.

4. Infrastructure Automation & DevOps

  • Build and maintain infrastructure automation using Terraform and related Infrastructure as Code (IaC) tools.
  • Develop and enhance CI/CD pipelines to streamline deployments and infrastructure changes.
  • Automate repetitive operational tasks, infrastructure provisioning, scaling, and deployment workflows.
  • Implement reliable deployment and rollback mechanisms.
  • Improve operational efficiency through scripting, automation, and standardized infrastructure processes.

5. Monitoring, Observability & Performance Optimization

  • Build and maintain monitoring systems, alerts, dashboards, and operational visibility tools.
  • Implement observability practices using Prometheus, Grafana, Loki, or equivalent platforms.
  • Monitor system health, resource consumption, service availability, and infrastructure performance.
  • Define reliability metrics and establish appropriate service-level objectives (SLOs).
  • Continuously optimize infrastructure performance, availability, and operational efficiency.

6. Capacity Planning & Disaster Recovery

  • Conduct infrastructure capacity planning to support growing workloads and increasing compute requirements.
  • Develop and maintain disaster recovery strategies and infrastructure resilience mechanisms.
  • Identify scalability requirements and plan infrastructure improvements proactively.
  • Ensure production systems can handle workload fluctuations and unexpected failures.

Must-Have Skills & Qualifications

  • Experience in Site Reliability Engineering, DevOps, Platform Engineering, or Infrastructure Engineering.
  • Strong hands-on experience operating and maintaining Kubernetes clusters in production environments.
  • Practical knowledge of Kubernetes upgrades, ingress, networking, autoscaling, scheduling, and cluster troubleshooting.
  • Strong Linux administration and system troubleshooting skills.
  • Solid understanding of networking fundamentals, including DNS, TCP/IP, load balancing, and connectivity troubleshooting.
  • Experience with production incident management, on-call support, root cause analysis, and postmortems.
  • Hands-on experience with Terraform, Helm, and CI/CD pipelines.
  • Familiarity with observability and monitoring tools such as Prometheus, Grafana, and Loki.
  • Experience working with cloud infrastructure on AWS, GCP, or Microsoft Azure.
  • Strong automation and scripting capabilities.

Good-to-Have Skills

  • Experience managing GPU infrastructure and high-performance computing environments.
  • Familiarity with GenAI infrastructure, model-serving platforms, and AI/ML workloads.
  • Experience optimizing Kubernetes clusters for compute-intensive workloads.
  • Knowledge of container runtimes, service meshes, and distributed systems.
  • Experience designing highly available and fault-tolerant infrastructure architectures.
  • Understanding of disaster recovery planning and infrastructure security best practices.

Ideal Candidate Profile

The ideal candidate is an infrastructure-focused engineer who has independently operated production Kubernetes environments and understands the operational challenges of maintaining reliable, scalable platforms. They should be comfortable handling production incidents, troubleshooting issues across infrastructure layers, and implementing automation to improve system reliability.

Candidates with experience supporting GPU workloads, AI infrastructure, and model-serving platforms will have an added advantage.

Haystack's AI agent can fill in and submit this application for you. How AI auto apply works

Will your resume get past this employer's screening? Check your resume against this job, free

Similar jobs