Sr. Data Engineer – Databricks / SQL / ADF

Introduction:

We are seeking a highly skilled Senior Data Engineer with expertise in Databricks, SQL, and ADF to join our team in Eden Prairie, MN. The ideal candidate will have 12+ years of experience in data engineering and a strong background in data warehousing and optimization.

Responsibilities:

• Develop and maintain data pipelines using Databricks, Apache Spark, and SQL
• Design and implement ETL/ELT processes for data transformation and loading
• Work closely with stakeholders to understand data requirements and deliver solutions
• Optimize query performance and ensure data quality and integrity
• Collaborate with cross-functional teams to support data analytics and reporting
• Stay current on industry trends and best practices in data engineering

Requirements:

Required Skills:

• Experience with SQL Server, Azure SQL, and advanced T-SQL
• Proficiency in Databricks, Apache Spark, PySpark, and ADF
• Knowledge of data warehousing concepts and dimensional modeling
• Hands-on experience with SCD (Slowly Changing Dimensions) and ETL/ELT processes
• Familiarity with Azure Cloud services
• Ability to tune queries and optimize performance

⚠️ In-person client interview in Eden Prairie, MN required.