Azure Data Engineer

Sample Tasks

• Develop and implement relational and non-relational databases in Azure.
• Develop and implement data transformations.
• Ensure data access patterns are optimized.
• Maintain necessary documentation.
• Coordinate with necessary teams to meet security standards.
• Implement disaster recovery solution.
• Provide knowledge transfer.

Desired Qualifications

• Experience with designing, developing, and implementing data lakes and relational and non-relational databases in Azure.
• Experience with Databricks.
• Experience with Oracle databases.
• Strong experience developing and implementing data transformation solutions and cloud infrastructure integration.
• Strong experience coding and testing programs and scripts to load data using Azure data load utilities.
• Strong experience with CI/CD pipelines.
• Experience with cloud computing concepts.
• Experience with tools such as Azure Monitor, Azure Data Factory, SQL Analytics, Query Performance Insight, Azure Resource Manager, and Azure CLI/PowerShell for infrastructure management.
• Experience in mentoring others in the needed technologies.
• Experience developing and implementing backup and recovery strategies using tools such as Azure Backup or Geo-replication.
• Experience with role-based access control, encryption, and network security.
• Strong organizational and time management skills.
• Desired 7 years experience designing, developing, and implementing data lakes and relational and non-relational databases in Azure.
• Knowledge of data concepts, data modeling, schema design, and indexing strategies.
• Knowledge of Azure SQL instances, managed instances, and elastic pools.
• Knowledge of Data Warehouse Administration and Teradata Data Warehouse.