Technology

Sr. Data Engineer

InfoBeans IncCharlotte, NC🇺🇸United States

Why this role stands out

This hybrid Senior Data Engineer role at InfoBeans Inc. offers an exciting opportunity to build and optimize enterprise-scale data platforms on Azure, leveraging cutting-edge technologies like Databricks and PySpark. You'll thrive here if you're a seasoned data professional with a passion for creating robust data solutions and collaborating with diverse teams to drive impactful business insights. Apply today to advance your career in a dynamic and forward-thinking environment.

Quick overview

SeniorityMid Senior

Work modeHybrid

LocationCharlotte, NC, United States

SQLSQL ServerETLScrumAgileAzureDatabricksGit

Job description

Job Overview:

We are seeking an experienced Senior Data Engineer to design, build, optimize, and support enterprise-scale data platforms on Azure. The ideal candidate will possess strong expertise in data ingestion, transformation, orchestration, and data warehousing using technologies such as Azure Databricks, Azure Data Factory (ADF), Delta Lake, PySpark, and Azure SQL. The candidate will work closely with business stakeholders, data architects, analysts, and application development teams to deliver scalable, high-performance, and reliable data solutions.

Responsibilities:
Design, develop, and maintain scalable data ingestion, transformation, and delivery pipelines.
Build ETL/ELT solutions using Azure Databricks, PySpark, and Azure Data Factory (ADF).
Develop and optimize Databricks notebooks, workflows, and scheduled jobs.
Implement and maintain Delta Lake-based Bronze, Silver, and Gold data layers.
Integrate data from databases, APIs, files, and cloud storage platforms.
Ensure data quality, performance, reliability, and operational support for production pipelines.
Collaborate with architects, analysts, and business stakeholders to deliver data solutions.

Qualifications:
Bachelor's degree in Computer Science, Information Technology, or a related field.
10+ years of experience in Data Engineering and Data Warehousing.
4+ years of hands-on experience with Azure Databricks and PySpark.
Experience working in Agile/Scrum environments.
Excellent communication and problem-solving skills.

Skills:
Azure Databricks (PySpark, Spark SQL, Delta Lake), Azure Data Factory (ADF), Databricks Jobs & Workflows, Azure Data Lake Storage (ADLS Gen2), Azure SQL Database / SQL Server / SQL, ETL/ELT Design & Development, Data Ingestion & Data Transformation, Data Modeling & Data Warehousing, Performance Tuning & Optimization, CI/CD, Git, Data Quality, Monitoring, Production Support