Data Engineer

About the Role

We are seeking an experienced Data Engineer to design, build, and maintain scalable cloud data pipelines supporting high-volume manufacturing and IoT data.

The ideal candidate will have strong hands-on experience with SQL and Python, modern cloud data platforms, and Lakehouse/Medallion architectures. This is a hands-on engineering role focused on building reliable data pipelines, processing large datasets, and developing scalable data solutions.

Key Responsibilities

• Design, develop, and maintain scalable cloud data pipelines for high-volume data.


• Build batch and real-time data processing solutions using Spark/PySpark, Kafka, and Airflow.


• Develop data ingestion, transformation, and integration workflows using SQL and Python.


• Design and implement Lakehouse and Medallion architecture solutions.


• Work with cloud data platforms including Databricks, Snowflake, AWS, and/or Azure.


• Build and optimize ETL/ELT pipelines for performance, scalability, and reliability.


• Process and integrate large volumes of manufacturing, operational, and IoT data.


• Troubleshoot data pipeline issues and improve data quality and performance.


• Collaborate with engineering, analytics, and business teams to develop production-ready data solutions.

Qualifications

• 5+ years of professional Data Engineering experience; additional experience is welcome for the right candidate.


• Strong proficiency in SQL and Python.


• Hands-on experience building scalable data pipelines.


• Experience with Lakehouse and/or Medallion architectures.


• Experience with Databricks, Snowflake, AWS, and/or Azure.


• Strong experience with Apache Spark and/or PySpark.


• Experience with Apache Kafka and/or other streaming technologies.


• Experience with Apache Airflow or other data orchestration tools.


• Experience working with Delta Lake or similar data lake technologies.


• Strong understanding of ETL/ELT, data integration, and data transformation.

Benefits

Full-time employees receive a benefits package, including:

• Medical, dental, and vision coverage


• 100% company contribution toward employee medical coverage


• 80% company contribution toward medical coverage for immediate dependents


• 15 days of PTO


• 10 paid holidays, including 8 fixed holidays and 2 floating holidays


• 401(k) enrollment with employee contributions


• Relocation assistance

Oscar Associates Limited (US) is acting as an Employment Agency in relation to this vacancy.