Data Engineer with Scala/DB2 @ New York, NY

Introduction

Our client is looking for a Data Engineer with strong Scala and DB2 performance skills to join their team in New York, NY. The ideal candidate will be responsible for developing and maintaining data pipelines, optimizing database performance, and ensuring data quality and integrity.

Responsibilities

• Develop and maintain data pipelines using Scala
• Optimize DB2 performance to ensure efficient data processing
• Design and implement ETL processes to extract, transform, and load data
• Collaborate with data scientists and analysts to understand data requirements
• Ensure data quality and integrity by implementing data validation and quality checks
• Troubleshoot and resolve data-related issues in a timely manner

Requirements

Required Skills:

• Proven experience as a Data Engineer
• Proficiency in Python, Scala, and SQL
• Strong knowledge of DB2 database management system
• Experience with ETL processes and tools

Preferred Skills:

• Experience working with data visualization tools
• Knowledge of machine learning algorithms
• Experience with cloud-based data platforms
• Excellent problem-solving and analytical skills