Azure Data Engineer (Power BI expertise) London - Perm

We are looking for a strong Azure Data Engineer with Power BI expertise who can manage end-to-end data engineering, reporting, and stakeholder-facing delivery.

Data Engineer - London - Permanent

Location: London (Onsite - 5 Days/Week)
Role: Data Engineer
Experience: 5-8 Years
Job type: Permanent

A strong Azure Data Engineer with hands-on experience in ADF, Synapse, Data Lake, Advanced SQL, Python, and Power BI. The candidate should be able to independently design data models, build pipelines, optimize SQL, create Power BI dashboards, and communicate clearly with stakeholders

Data Modeling and Architecture:

• Design and Develop Data Models: Create and maintain scalable, efficient, and reliable data models to support Business Intelligence and analytics needs.
• Architectural Strategy: Develop and implement architectural strategies for data storage, processing, and retrieval using Azure cloud services.

Data Pipeline Development:

• ETL Processes: Design, develop, and maintain ETL processes to ingest, transform, and load data from various sources into Azure data services.
• Data Pipeline Construction: Build robust data pipelines using Azure Data Factory (ADF) to ensure smooth data flow and integration between different systems.

Data Storage and Management:

• Data Lakehouse Management: Design, implement, and manage data-Warehouse/lake-houses on Azure, ensuring optimal performance, scalability, and cost-efficiency.
• Azure Synapse Analytics: Utilize Azure Synapse to develop, optimize, and manage data warehousing solutions for large-scale data analytics.

Automation and Scripting:

• Python Automation: Develop and maintain Python scripts for automating data processing tasks and workflows.
• CI/CD Pipelines: GOOD to HAVE - Implement continuous integration and continuous deployment (CI/CD) pipelines for automated testing and deployment of data engineering solutions.
• Data Visualization and Reporting:

• Power BI Development: Design and create interactive dashboards and reports using Power BI to enable data-driven decision-making.
• End-User Support: Provide support and training to end-users for effective utilization of data visualization tools.
• Database Management:

SQL Development:

• Write and optimize complex SQL queries for data extraction, transformation, and loading operations.
• Database Administration:
• Manage and administer Azure SQL databases, ensuring data integrity, security, and performance.
• Collaboration and Communication:

Stakeholder Engagement:

• Collaborate with business stakeholders to understand data requirements and translate them into technical specifications.
• Cross-Functional Team Collaboration: Work closely with data scientists, analysts, and other engineering teams to deliver comprehensive data solutions.
• Performance Optimization:

System Monitoring:

• Monitor data systems for performance, security, and reliability issues, and implement enhancements as needed.
• Troubleshooting and Problem Resolution: Identify and resolve data-related issues promptly to ensure the smooth operation of data processes.
• Documentation and Compliance:

Documentation: Maintain comprehensive documentation for data models, pipelines, and processes to ensure knowledge sharing and continuity.
Compliance and Security: Ensure all data solutions comply with organizational policies, industry standards, and regulatory requirements.

Must-Have Skills

• Azure Data Services: ADF, Synapse, Data Lake, Azure SQL, DW Pool
• Databases: Azure SQL, MySQL, MariaDB
• Languages: Advanced SQL, Python
• Reporting: Power BI
• Data Engineering: ETL/ELT, pipelines, data modelling, performance optimization
• Communication: Strong UK client-facing communication and ability to clearly explain project role and contribution

Good to Have

• Azure DevOps
• CI/CD pipeline experience
• Azure Functions
• Logic Apps
• Key Vault

If interested to hear more about this role, please send your CV to (see below) with the best contact details to get connected for a quick discussion on the same.

Regards,

Mary Priscilina