Back to Jobs
Recently postedTemporary/CasualTechnology

Data Engineer - Senior Analyst

Opus Recruitment Solutions LtdCity, Newcastle Upon Tyne🇬🇧United Kingdom

Quick overview

SeniorityMid Senior
Employment typeTemporary/Casual
Work modeHybrid
LocationCity, Newcastle Upon Tyne, United Kingdom
DockerGitAWSFlinkGitHub ActionsJavaJenkinsKafkaPythonTerraformAzureKubernetesCI/CDAzure DevOps

Job description

  • Build and optimise data pipelines using Java (preferred) or Python.
  • Develop Real Time streaming and batch data pipelines.
  • Work with Kafka, Flink or Spark, with Kafka/Flink preferred.
  • Develop AWS-based data solutions using Kinesis, MSK, Lambda and Glue.
  • Implement data governance, lineage, security and quality controls.
  • Support CI/CD using Azure DevOps, GitHub Actions or Jenkins.
  • Use Terraform and Infrastructure as Code practices.
  • Deploy containerised workloads using Docker, Kubernetes and AWS EKS.
  • Collaborate with analytics, AI/ML, product and engineering teams.

Similar jobs