Senior Data Engineer

Location: Malvern, PA (Onsite)
Duration: Long-Term Contract
Experience Required: 8+ Years

Job Summary

We are seeking a highly skilled Senior Data Engineer with strong expertise in Python, SQL, and AWS cloud technologies to design, develop, and optimize scalable data solutions. The ideal candidate will have extensive experience building modern data pipelines, ETL/ELT frameworks, cloud-native architectures, and large-scale data processing systems. This role will be responsible for developing robust data platforms that support analytics, reporting, machine learning, and business intelligence initiatives.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Python and AWS services.
• Build and optimize ETL/ELT workflows for ingesting, transforming, and loading large datasets.
• Develop cloud-native data solutions leveraging AWS services such as Glue, S3, Lambda, Redshift, Athena, CloudWatch, and IAM.
• Write complex and optimized SQL queries for data extraction, transformation, validation, and reporting.
• Design and implement data models for analytics and business intelligence platforms.
• Monitor, troubleshoot, and optimize data workflows to ensure reliability and performance.
• Collaborate with Data Scientists, Analysts, Architects, and Business stakeholders to understand data requirements and deliver solutions.
• Implement data quality, governance, security, and compliance standards across data platforms.
• Build automation frameworks for data processing and operational support.
• Participate in code reviews, architecture discussions, and technical design sessions.
• Create technical documentation and maintain best practices for data engineering processes.

Required Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.
• 8+ years of experience in Data Engineering and Data Warehousing.
• Strong hands-on experience with Advanced Python programming for data engineering applications.
• Extensive experience with SQL and relational databases.
• Strong AWS experience with:
  • AWS Glue
  • Amazon S3
  • AWS Lambda
  • Amazon Redshift
  • AWS Athena
  • CloudWatch
  • IAM
• Experience building and maintaining large-scale ETL/ELT pipelines.
• Strong understanding of data modeling, data warehousing, and dimensional modeling concepts.
• Experience with performance tuning and optimization of SQL queries and data pipelines.
• Knowledge of CI/CD practices and version control tools such as Git.
• Strong troubleshooting and problem-solving skills.

Preferred Qualifications

• Experience with Apache Spark, PySpark, or distributed data processing frameworks.
• Experience with Airflow or other workflow orchestration tools.
• Knowledge of streaming technologies such as Kafka or Kinesis.
• Experience working in Agile/Scrum environments.
• Exposure to Snowflake, Databricks, or other modern data platforms.
• AWS certifications are a plus.

Technical Skills

Programming:

• Python (Advanced)
• SQL

Cloud & Data Services:

• AWS Glue
• Amazon S3
• AWS Lambda
• Amazon Redshift
• AWS Athena
• CloudWatch
• IAM

Tools & Technologies:

• Git
• CI/CD Pipelines
• ETL/ELT Frameworks
• Data Warehousing
• Data Modeling

Nice to Have

• PySpark / Spark
• Airflow
• Kafka
• Snowflake
• Databricks
• Machine Learning Data Pipelines

Keywords: Senior Data Engineer, Python Data Engineer, AWS Data Engineer, ETL Developer, Data Warehouse Engineer, AWS Glue, Redshift, Lambda, S3, SQL, PySpark, Airflow, Data Pipelines, Cloud Data Engineering.