Quick overview
Job description
We are seeking an expert Kubernetes engineer to configure, deploy, and operate mission-critical Amazon EKS infrastructure supporting petabyte-scale data processing workloads. This role requires deep technical expertise in Kubernetes internals, large-scale cluster management, and Apache Spark optimization to support thousands of concurrent jobs processing large volumes of Big data.
Responsibilities :
- Design, deploy, and maintain production-grade Amazon EKS clusters architected for petabyte-scale data processing with high availability and fault tolerance
- Operate in air-gapped private VPC environments without internet access, managing secure package repositories and container registries
- Debug and resolve complex distributed systems issues across EKS, Karpenter, and Spark, including scheduling bottlenecks, node scaling delays, and cascading failures under heavy load
- Implement Karpenter consolidation and disruption policies balancing cost optimization with job resiliency
- Manage spot and on-demand instance strategies with robust node interruption handling
- Define and enforce ResourceQuotas, LimitRanges, and PriorityClasses to ensure fair resource distribution and prevent resource starvation
- Configure persistent volume claims and provision container-native storage using Amazon EBS CSI driver for block storage and Amazon EFS CSI driver for shared file access
- Optimize storage configurations for resiliency, high-throughput data processing workloads
- Implement logging, alerting, and anomaly detection to identify provisioning failures, executor loss, and throughput degradation before broader system impact
- Design fault-tolerant architectures with retry strategies, checkpointing, and graceful degradation patterns minimizing re-computation on failure
- Develop and manage configs in a private VPC without internet access
- Bachelor's degree in Computer Science, Information Systems or related discipline with at least eight (8) years of related experience, or equivalent training and/or work experience; Master's degree and past Financial Services industry experience preferred.
- Kubernetes certification (CKA, CKAD, or CKS) & AWS certifications
- Active contributions to open-source Kubernetes, Karpenter, or Spark projects
- Familiarity with FinOps practices and cost optimization at scale
- Background in data engineering or analytics platforms
SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company to request an accommodation or assistance regarding our policy.
Similar jobs
- SC

DevOps EngineerRecently posted
ShrinQ Consulting Group Inc · West Virginia · Hybrid · Posted 16 Nov 2026 🇺🇸
DockerGCPSQL+8TechnologySalary not listed - SY

L2 Application Support Engineer (SRE)Recently posted
Synechron · North Carolina · Hybrid · Posted 16 Nov 2026 🇺🇸
OracleSQLShell+7Technology$90k - $100k/yr - IN
Site Reliability Engineer (SRE)Recently posted
Intellibus · Newark, New Jersey · Hybrid · Posted 16 Nov 2026 🇺🇸
SQLLLMPython+2Technology$75 - $85/hr - SY

Platform / Site Reliability (SRE) - L2 Application SupportRecently posted
Synechron · North Carolina · Hybrid · Posted 16 Nov 2026 🇺🇸
OracleSQLShell+7Technology$90k - $100k/yr - ZA
DevOps / SRE EngineerRecently posted
Zapnix LLC · Englewood, New Jersey · On-site · Posted 16 Nov 2026 🇺🇸
DockerGitAWS+14TechnologySalary not listed - DR
Staff Site Reliability EngineerRecently posted
Doghouse Recruitment · West Virginia · Remote · Posted 16 Nov 2026 🇺🇸
DockerAnsibleDNS+7Technology$350k/yr - SY

Site Reliability EngineerRecently posted
Synechron · North Carolina · Hybrid · Posted 16 Nov 2026 🇺🇸
GCPMySQLOracle+23Technology$95k - $100k/yr - SY

Platform / SRE EngineerRecently posted
Synechron · North Carolina · Hybrid · Posted 16 Nov 2026 🇺🇸
DockerGCPMySQL+21Technology$90k - $100k/yr - CL
DevOps EngineerRecently posted
Clinisoltech · Mundelein, Illinois · On-site · Posted 16 Nov 2026 🇺🇸
DockerDynamoDBMicroservices+28Technology$65k - $90k/yr - MA

Lead AI Platform Engineer
MassMutual · Ridgewood, NJ · Hybrid · Posted 8 Nov 2026 🇺🇸
OWASPLLMKubernetes+1TechnologySalary not listed - TT
Senior Platform EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 16 Nov 2026 🇺🇸
DockerAWSKafka+5Technology$175k - $220k/yr - TT
Lead Platform EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 15 Nov 2026 🇺🇸
FastAPIMicroservicesEncryption+6Technology$220k - $300k/yr
