Data engineer for machine learning

Описание:

Solirius Reply, part of the Reply Group, is a technology consultancy and digital transformation partner that helps organisations solve complex challenges through strategy, design, engineering, and delivery.We work closely with our clients to deliver secure, accessible, user-focused services that evolve with their needs. By combining deep technical expertise with people-centred design, we create solutions that deliver meaningful, lasting impact.

Задачи:

Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based. Working collaboratively with the client and cross-functional teams to identify and address data-related issues and opportunities. Stay updated with the latest trends and developments in the data engineering field, such as modern data stack, big data technologies, cloud computing, etc Assist with defining the processes needed to achieve operational excellence Ensure data quality across all projects/clients Define and manage SLA’s for data sets and processes throughout production Lead on the design, build and launch of new data models and pipelines

Требования:

Experience in operating as part of data engineering teams and independently. Line/Team management experience, leadership experience Experience of working with cloud infrastructure (Azure or AWS, GCP is beneficial) SQL and relational databases (e.g. MS SQL/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on coding experience, such as Python Reporting tools (e.g. Tableau, PowerBI, Qlik) Passionate, motivated and enthusiastic about developing technology solutions. Experience working in an Agile development environment Data architecture experience. Будет плюсом: Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo; GDPR and Government Service Standard (desirable)

Условия:

• Competitive Salary


• Bonus Scheme


• Private Healthcare Insurance


• 25 Days Annual Leave + Bank Holidays


• Up to 10 days allocated for development training per year


• Enhanced Parental Leave


• Paid Fertility Leave (5 Days)


• Contributory Pension


• EAP with Membership Benefits


• Flexible Benefits Allowance


• Cycle to Work and Electric Vehicle schemes


• Flexible Working


• Annual Away Days/Company Socials

#J-18808-Ljbffr