Data Engineer - DEFRA

Senior Data Engineer - Azure Central government | Outside IR35 | Remote | 6 months + SR2 is working with a consultancy that is expanding its data engineering capability to support the delivery of a large-scale cloud data platform. They are looking for an experienced Data Engineer to help design and develop modern data solutions capable of handling complex, high-volume datasets. You'll join a multidisciplinary team responsible for developing and evolving a cloud-based data platform. Working across the full data lifecycle, you'll help shape how data is collected, processed, governed and consumed, while contributing to architectural decisions and engineering best practice. A significant proportion of the work involves processing complex location-based datasets, making previous exposure to geospatial or mapping-related data highly beneficial.

Requirements:

Strong commercial experience delivering data engineering solutions in Azure.<br />Strong hands-on experience working with Azure Databricks<br />Experience working with geospatial, mapping or location intelligence datasets<br />Central UK government experience within recent 5 years<br />Experience developing large-scale distributed data processing workloads.<br />Strong Python and SQL development skills.<br />Experience working with Spark-based technologies.<br />Knowledge of modern cloud data platform patterns and architectures.<br />Experience building and supporting automated data pipelines.<br />Familiarity with CI/CD practices and modern software engineering principles.<br />Strong troubleshooting and performance optimisation skills.Details Outside IR35<br />£450 a day<br />Remote based<br />6 month contract<br />Strong likelihood of extension Please apply with a copy of your CV and Emma from SR2 will contact potential applicants regarding next steps