Cloud Data Engineer - Cloud, Python

Cloud Data Engineer (Python)

Up to £54,150 per annum + excellent pension | Hybrid working | London, Manchester, Cardiff, Belfast, Edinburgh or Darlington

Are you an experiencedData or Software Engineer with hands-on experience of:

Python and end to end Cloud deployment, looking for a role where your work can make a real difference?

Our Government client is looking for aData Engineerto join itsData, Technology and Insights (DTI)unit on a12-month fixed-term contract.

Youll join a multidisciplinary team ofdata engineers, data scientists, technologists, behavioural scientists and digital forensics experts, working on data processing and analytical projects for both internal team and user-initiated projects.

This is a hands-on role where youll spend most of your time designing, building and maintaining data solutions, with plenty of opportunity for learning and professional development.

The Role

As a Data Engineer, youll help build and operate reliable, scalable data infrastructure and pipelines across anAWS cloud environment. Producing high-quality code in Python (and other languages, as needed).

Your responsibilities will include:

• Design, build and maintainscalable data pipelinesto ingest, transform and process large and complex datasets.
• Develop automatedweb scraping and bulk data acquisition workflows.
• Implement datatransformation, validation, testing and quality controlsto ensure datasets are reliable, reproducible and ready for analysis.
• Build and maintaincontainerised data and analytics applications, including dashboards and data tools.
• Implement and manageworkflow orchestration and schedulingto ensure data pipelines and jobs are observable, reliable and maintainable.
• ApplyInfrastructure as Code (IaC)to support data pipelines and processing workflows on AWS.
• Design and maintain systems fordata version control and reproducible machine learning workflows (MLOps).
• Work closely withdata scientists, analysts and engineersto translate analytical and operational requirements into effective data solutions.
• Contribute to a collaborative, multidisciplinary environment and share knowledge with colleagues.

About You

Were looking for a Data or Software Engineer who has experience delivering production data solutions and enjoys solving complex data problems.

Essential experience

• Experience deliveringproduction data pipelines end-to-end, including design, development, implementation and operational maintenance in acloud environment.
• Experience writingproduction-quality Pythonto work with complex, messy or large datasets (Minimum 2 years)
• Anundergraduate degree in a quantitative subject, or equivalent professional experience indata engineering, data science or cloud development.
• A strong understanding ofdata engineering best practices, including data modelling, transformation, validation, testing.
• Experience working collaboratively withinmultidisciplinary teams.
• Strong communication skills, with the ability to explain technical work clearly and engage with non-technical audiences.

Why Join?

This is an opportunity to use your technical expertise on diverse projects that have ameaningful impact on the public good.

Youll work alongside specialists from a range of disciplines, tackling interesting and complex data challenges while continuing to develop your technical skills.

Youll also receive:

• £49,400 salary + DDAT Allowance of up to £4,750 dependent upon experience
• Excellent pension
• 12-month fixed-term contract
• Hybrid working
• Choice of office location:London, Manchester, Cardiff, Belfast, Edinburgh or Darlington
• Opportunities forlearning and professional development including 10 L & D days per annum.
• The opportunity to work with experienced data, technology and analytical specialists

Apply Now

If youre an experiencedData or Software Engineer with strong Python and Cloud experienceand want to use your skills in a role with genuine public impact, wed love to hear from you.