Quick Overview
Job Description
Design, build, and optimise data pipelines using Spark / PySpark, Design, develop and maintain AWS-native data solutions leveraging services including Glue, Glue Catalog, S3, Airflow, DBT, and Starburst/Presto. Supporting large-scale migration of legacy and bespoke data pipelines. Developing robust ETL and ELT processes using modern data engineering practices. Support the migration of existing data assets into modern cloud-based architectures. Contributing to data platform optimisation, automation, and continuous improvement initiatives. Implement data quality, monitoring, and performance optimisation practices. Work closely with architects, analysts, and stakeholders to deliver reliable and scalable data solutions. Troubleshoot complex data engineering issues and identify opportunities for improvement. Contribute to technical design discussions and engineering best practices. Provide consulting expertise and communicate effectively with customer stakeholders.
What We're Looking ForCore Skills and Experience Minimum 5 years working as a Data Engineer in enterprise-scale environments. Hands on experience building pipelines with Spark and PySpark. Strong knowledge of the AWS data ecosystem, including: AWS Glue Glue Catalog Amazon S3 Starburst / Presto Apache Airflow DBT services for Transformation Experience designing and supporting complex data pipelines and data integration solutions. Strong understanding of cloud-based data architectures and engineering best practices. Excellent problem solving and analytical skills. Strong stakeholder engagement and communication skills. Customer focused mindset with the ability to work directly with senior business and technical stakeholders. Desirable Financial Services industry experience. Consulting experience within client facing environments. Experience delivering large scale cloud migration or modernisation programs. Exposure to modern data lake, lakehouse, and distributed data processing architectures.
You'll join a team that valuesBe Innovative. Be Curious. Be Humble. Be Yourself.
Expect a collaborative culture, meaningful projects, and a strong focus on learning and growth.You'll have the opportunity to work alongside highly skilled consultants, contribute to impactful client outcomes, and continue developing your expertise within a supportive and inclusive environment.
We'd love to hear from passionateIf you're passionate about modern data engineering, cloud technologies, and helping organisations unlock value from their data, we'd love t
Similar jobs
- TC
GCP Data Engineer - ETL/ELT Pipelines & Looker Studio
NewTata Consultancy Services Limited
Sydney, New South Wales🇦🇺Hybrid3 hours agoSQLETLLooker+4Technology - TT
Senior Database Engineer
NewThe Trade Desk, Inc.
Sydney, New South Wales🇦🇺A$165k - A$215k/yrHybrid4 hours agoSQLSQL ServerAWS+2Technology - XC
Senior Data Engineer: Spark on AWS and Cloud Modernisation
NewXpert Consulting T/A Novon
Australia🇦🇺Hybrid6 hours agoAWSAirflowdbtTechnology - SC
Senior AWS Data Engineer - Remote DataOps & Security
NewShowtime Consulting Pty Ltd
Canberra, Australian Capital Territory🇦🇺Remote6 hours agoSQLAWSAirflow+2Technology - TC
GCP Data Engineer
NewTata Consultancy Services Limited
Sydney, New South Wales🇦🇺Hybrid7 hours agoDockerGCPSQL+11Technology - BF
Data Administrator
NewButterfly Foundation
Australia🇦🇺Hybrid7 hours agoCRMMental Health