Start searching
Back to Jobs
Recently postedRemoteTechnology

Senior Data Engineer

Rivago infotech incUnited States🇺🇸United States

Quick overview

SeniorityMid Senior
Work modeRemote
LocationUnited States
SQLApache SparkETLDatabricksUnityAzure

Job description

Role: Senior Data Engineer – DataStage to Azure Databricks Migration

Location: Remote

Persistent systems

Job Description:

·       Strong hands-on experience in IBM DataStage, Teradata, SQL and Azure Databricks.

·       Analyze existing DataStage jobs and their Teradata dependencies.

·       Knowledge of Teradata utilities/components such as BTEQ and TPT.

·       Experience configuring or working with JDBC/ODBC database connectivity from ETL platforms.

·       Identify and remediate Teradata-specific SQL for compatibility with Databricks/Spark SQL

·       Perform data reconciliation and validation, including row-count and checksum validation.

·       Troubleshoot migration issues related to SQL, connectivity, schemas, metadata and data types.

·       Support unit testing, SIT, UAT, cutover and post-production stabilization.

·       Good understanding of ADLS Gen2, Delta tables, Unity Catalog and Azure connectivity/security.

·       Experience in large-scale Teradata-to-Azure/Databricks migration is preferred.

Similar jobs

Apply