Quick Overview
Job Description
Hello,
we are hiring
Position: Data Engineer
Location: Minneapolis, MN/Chicago, IL
Contract
About this role:
We are seeking an experienced Data Engineer with strong expertise in Python, PySpark, and big data technologies to design, build, and maintain scalable data pipelines.
The ideal candidate should have experience working with large datasets, cloud platforms, and modern data engineering frameworks to support analytics and business intelligence initiatives.
Key Responsibilities:
Design, develop, and maintain scalable ETL/ELT data pipelines using Python and PySpark.
Process and transform large volumes of structured and unstructured data.
Develop and optimize Spark jobs for high-performance data processing.
Build and maintain data ingestion frameworks from multiple data sources.
Work with data lakes and data warehouses to ensure reliable data availability.
Collaborate with data scientists, analysts, and business stakeholders to deliver data solutions.
Optimize SQL queries and data models for performance and scalability.
Implement data quality, validation, and monitoring processes.
Troubleshoot and resolve data pipeline and performance issues.
Follow best practices for data governance, security, and documentation.
Required Experience and Knowledge:
7+ years of experience in Data Engineering.
Strong programming experience in Python.
Hands-on experience with PySpark and Apache Spark.
Strong SQL skills and experience with relational databases.
Experience building ETL/ELT pipelines.
Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
Knowledge of distributed data processing and big data technologies.
Experience with orchestration tools such as Apache Airflow or similar.
Familiarity with Git and CI/CD practices
Skills
Similar jobs
Data Engineer - TRANSCOM with Security Clearance
Agile Defense, Inc. · Scott AFB, United States
16 minutes ago$130k - $155k/yrData Engineer - CDAO Central with Security Clearance
Agile Defense, Inc. · Washington, United States
16 minutes ago$140k - $165k/yrData Engineer
Altitude Technology Solutions Inc · New York, United States
19 minutes agoData Engineer
Apex Systems · Omaha, United States
19 minutes agoData Engineer
RADGOV INC · Wilmington, United States
35 minutes agoSenior Data Engineer — MDM (Profisee)
TUPPL Technology Inc · Dallas, United States
36 minutes ago