DevOps Engineer II

About the Role

We are looking for a DevOps Engineer II with strong hands-on experience in Databricks, databases, Kubernetes, and AWS.
Key Responsibilities

Databricks

• Manage and maintain Databricks infrastructure and production workloads.
• Manage clusters, jobs, compute resources, configurations, permissions, and integrations.
• Monitor Databricks workloads and troubleshoot performance and reliability issues.
• Drive Databricks cost optimization through cluster sizing, autoscaling, job optimization, scheduling, and resource utilization.
• Establish best practices around Databricks governance, security, access management, and operational efficiency.

Database & Data Infrastructure

• Strong hands-on experience managing databases in production environments.
• Perform database maintenance, monitoring, troubleshooting, performance tuning, backup/recovery, and capacity management.
• Work with databases such as PostgreSQL, MySQL, Aurora, Redis, or similar technologies.
• Troubleshoot database performance, connectivity, storage, replication, and availability issues.
• Identify opportunities for database cost and performance optimization.

AWS & Cloud Infrastructure

• Hands-on experience with AWS infrastructure and services, including EKS, EC2, RDS/Aurora, S3, IAM, CloudWatch, VPC, ECR, and related services.
• Manage and maintain production AWS infrastructure with a strong focus on reliability, security, scalability, and cost optimization.
• Troubleshoot complex infrastructure and networking issues.

Kubernetes & DevOps

• Strong hands-on experience with Kubernetes, preferably AWS EKS.
• Experience with deployments, troubleshooting, scaling, networking, workloads, ingress, storage, and cluster maintenance.
• Experience with Helm, ArgoCD, Terraform, GitHub Actions/Bitbucket Pipelines, or similar DevOps tools.
• Build and maintain CI/CD pipelines and automate repetitive operational tasks.
• Implement Infrastructure as Code and follow best practices for infrastructure provisioning and management.

Monitoring & Reliability

• Experience with monitoring and observability tools such as Prometheus, Grafana, CloudWatch, OpenTelemetry, or similar.
• Build dashboards, alerts, and operational metrics for production systems.
• Participate in incident management, root-cause analysis, and reliability improvements.
• Ensure production systems meet availability, performance, and operational requirements.

Required Skills

• 4–7+ years of DevOps / Cloud / Infrastructure experience
• Strong hands-on experience with Databricks
• Strong experience with AWS
• Strong hands-on experience with Kubernetes / EKS
• Strong database administration and troubleshooting experience
• Terraform / Infrastructure as Code
• CI/CD and Git-based workflows
• Helm and GitOps tools such as ArgoCD
• Monitoring and observability
• Strong Linux and networking fundamentals
• Strong troubleshooting and problem-solving skills
• Experience working with production environments at scale