Data Engineer

Role: Data Engineer
Location: Charlotte, NC - Locals only

Required Skills: Cloud, Google BigQuery, SQL, DB2

Job Description:

We are looking for an experienced Data Engineer with strong expertise in cloud-based data platforms, Google BigQuery, SQL, and IBM DB2. The ideal candidate will be responsible for designing, developing, optimizing, and maintaining scalable data pipelines and data integration solutions.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines and ETL/ELT processes.
• Work with Google Cloud Platform (Google Cloud Platform), particularly BigQuery, for data storage, processing, and analytics.
• Develop complex SQL queries, stored procedures, and database optimization solutions.
• Work with IBM DB2 databases, including data extraction, transformation, integration, and migration.
• Perform data integration between cloud platforms and on-premises databases.
• Optimize query performance and ensure data quality, consistency, and reliability.
• Collaborate with data architects, analysts, and application teams to understand business requirements.
• Troubleshoot data pipeline issues and ensure smooth data operations.

Required Skills:

• Strong experience as a Data Engineer.
• Hands-on experience with Google Cloud Platform (Google Cloud Platform).
• Strong knowledge of Google BigQuery.
• Advanced SQL skills, including complex queries, joins, and stored procedures.
• Hands-on experience with IBM DB2 database.
• Experience with ETL/ELT processes and data pipeline development.
• Knowledge of data warehousing concepts and database performance tuning.
• Experience working with large datasets and cloud-based data solutions.

Preferred Qualifications:

• Experience with Python or PySpark.
• Knowledge of Apache Airflow or other workflow orchestration tools.
• Experience with Google Cloud Platform services such as Cloud Storage and Dataflow.
• Experience with database migration and cloud modernization projects.