Quick Overview
Seniority
Mid Senior
Work mode
On Site
Location
Irving, TX, United States
Posted
Yesterday
DockerAzureKubernetes
Job Description
PySpark Data Engineer
Location: Irving, TX (3 Days Onsite/week)
Duration: Fulltime
Job Description:
We are looking for an experienced PySpark Developer with over 7 years of hands-on experience in designing, developing, and optimizing large-scale data processing applications. The ideal candidate should have strong expertise in PySpark, Azure cloud services, Docker, and Azure Kubernetes Service (AKS), with the ability to build scalable, secure, and high-performing data solutions.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines using PySpark for large-volume data processing.
- Work with Azure cloud services to build reliable and efficient data engineering solutions.
- Deploy, manage, and monitor containerized applications using Docker and Azure Kubernetes Service (AKS).
- Collaborate with data architects, analysts, and business stakeholders to understand requirements and deliver high-quality data solutions.
- Optimize PySpark jobs for performance, scalability, reliability, and cost efficiency.
- Implement best practices for data ingestion, transformation, validation, and processing across cloud environments.
- Identify and fix application, container, and platform vulnerabilities to ensure secure deployments.
- Support troubleshooting, production issue resolution, and performance tuning of data pipelines and cloud-based applications.
- Participate in code reviews, technical discussions, deployment planning, and documentation activities.
Similar jobs
- AP
Oracle Database Engineer
NewAptino
Chesterfield, MO🇺🇸On-siteYesterdayOracleAWSGoogle CloudTechnology - ST
Data Engineer III
NewStefanini
Richmond, VA🇺🇸RemoteYesterdayTableauAgileJira+2Technology - SY
Sr Data Engineer with AWS Databricks exp Required.
NewSymphony Corporation
Malvern, PA🇺🇸On-site2 days agoSQLAWSETL+5Technology - TN
Senior Data Engineer - Azure, DataBricks, Python
NewTechnology Navigators
Austin, TX🇺🇸HybridYesterdayAzureDatabricksJira+1Technology - IS
AWS Data Engineer | Local to WA
NewInabia Software & Consulting Inc.
Redmond, WA🇺🇸$80 - $87/hrOn-siteYesterdaySQLAWSETL+6Technology - AT
Oracle DBA
NewAce Technologies, Inc.
Charlotte, NC🇺🇸HybridYesterdayOracleSQLTechnology