Data Engineer (ADF/Databricks)

This leading commercial retailer are looking for an experienced Data Engineer to join them as part of their continued data build & enablement strategy. As a Data Engineer, you will be responsible for developing and maintaining data pipelines, optimising databases, creating ETL processes, designing data models and ensuring data quality.

Client Details

Leading Global Commercial Retailer based in Nottingham.

Description

This leading commercial retailer are looking for an experienced Data Engineer to join them as part of their continued data build & enablement strategy. As a Data Engineer, you will be responsible for developing and maintaining data pipelines, optimising databases, creating ETL processes, designing data models and ensuring data quality. Reporting into the Lead Data Engineer, you will use your expertise in data engineering to derive valuable insights from data assets and shape data excellence across the organisation.

Key Responsibilities:

• Develop and maintain robust data pipelines to ingest, process, and transform data from various sources, while ensuring data reliability and quality
• Implement seamless data integration processes supporting the continuous flow of information across the organisation
• Design, optimise and manage databases to proficiently oversee data retrieval and storage, prioritising performance, availability and scalability
• Craft efficient ETL processes transforming raw data into usable formats, including data cleaning, aggregation, and enrichment, streamlining data processing for enhanced efficiency
• Build and maintain data warehouses for structured data storage, ensuring it is organised for easy retrieval, reporting and analysis
• Implement stringent data quality checks and validation processes to ensure high accuracy, proactively monitoring and rectifying data integrity issues
• Optimise data pipelines and databases for performance and scalability, anticipating future growth and evolving business needs
• Enforce robust data security measures to uphold privacy regulations and safeguard against unauthorised access, ensuring data asset protection
• Maintain comprehensive documentation for data pipelines, processes, and models, ensuring seamless knowledge transfer and ongoing support
• Collaborate closely with cross-functional teams, fostering a data-driven culture by understanding requirements and delivering effective solutions together

Profile

Key Skills & Expertise:

• Proven experience as a Data Engineer or similar role
• Full UK Driving Licence required
• Strong SQL skills with relational and NoSQL databases
• Demonstrated experience with data pipeline and ETL tools (eg Azure Data Factory, Azure Logic Apps, Databricks, API's)
• Understanding of different data environments (Data Lakes, Synapse, Delta Lakes)
• Proficiency in programming languages such as Python, Java, or Scala
• Sound knowledge of data modelling, database design principles, data warehousing and data visualisation tools
• Excellent attention to detail and creativity to design, develop and inform overall business strategy
• Ability to work collaboratively and is open to new ideas whilst appreciating the difference each person makes

Job Offer

• Permanent Data Engineer position.
• Salary of £55,000 to £57,000, dependent on the level of experience.
• Excellent Benefits Package
• One day per week onsite in Nottingham, on Tuesdays.

If you're interested in this role, apply now.

People are at the heart of Michael Page. We are committed to creating an inclusive environment. As an inclusive recruiter we welcome applications from people of all backgrounds, identities and experiences. If you require any adjustments or accommodations during the recruitment process, we'll work with you to ensure you can perform at your best.