Quick Overview
Seniority
Mid Senior
Employment type
Full Time
Work mode
Hybrid
Location
Sydney, Sydney, Australia
SQLAWSSnowflakeAirflowApacheGitHub ActionsPythondbt
Job Description
Responsibilities
- Building and maintaining dbt transformation models across multiple pipeline layers - from raw ingestion through to governed, consumer-ready datasets
- Writing Snowflake SQL for complex transformations: type casting, deduplication, incremental load logic, surrogate key generation
- Developing and debugging Apache Airflow DAGs on AWS ECS
- Contributing to AWS Lambda-based ingestion( Python) - file validation, control file generation, S3 event handling
- Maintaining source-to-target mapping documentation and aligning models to business requirements and data specs
- Supporting onboarding of downstream consumers via data sharing mechanisms and event-driven notifications
- Participating in code reviews, writing YAML-based data quality tests, and owning tickets from design through to production
- Strong SQL
- Proficiency with dbt Core (Must have)
- Apache Iceberg Table format (Nice to have)
- Apache Airflow
- AWS -Working Knowledge of S3, Lambda, MWAA, ECS, Glue Catalogs, Lake Formation, Lambda, SQS, EventBridge
- Experience with fixed-format or structured financial data files
- CICD with Github Actions.
Confidentiality is assured, and only shortlisted candidates will be notified for interviews
Similar jobs
- WG
Senior Data Engineer - Reconciliation, AI & Automation
NewWestpac Group
Australia🇦🇺Hybrid1 hour agoOracleSQLSQL Server+7Technology - WG
Senior Data Engineer - AI-Driven Banking & Automation
NewWestpac Group
Australia🇦🇺Hybrid1 hour agoGenerative AITechnology - FL
Principal Data Engineer
NewFlybuys
Melbourne, Victoria🇦🇺Remote1 hour agoSQLAWSETL+10Technology - SC
Azure Data Engineer - Secure Cloud & Analytics Lead
NewShowtime Consulting Pty Ltd
Canberra, Australian Capital Territory🇦🇺Hybrid1 hour agoSQLAzureDatabricks+1Technology - NP
Senior Palantir Foundry Data Engineer
NewNixil Pty
Sydney🇦🇺On-site1 hour agoSQLGitKafka+1Technology - OG
Senior Data Engineer - Cloud Pipelines & Analytics Lead
NewO'Brien Group
New South Wales🇦🇺Hybrid2 hours agoTechnology - NP
Senior Palantir Foundry Data Engineer NV1/NV2/TSPV Clearance
NewNixil Pty
Sydney🇦🇺Hybrid2 hours agoTechnology - MA
Data Engineer Databricks
NewMane
Sydney🇦🇺Hybrid2 hours agoSQLSQL ServerAWS+5Technology - RC
Lead Data Engineer - dbt, Snowflake & Airflow on AWS
NewRecruit CRM
Sydney🇦🇺Hybrid2 hours agoSQLAWSSnowflake+3Technology - HA
Data Engineer (Snowflake)
NewHays
Melbourne, Victoria🇦🇺Hybrid2 hours agoSQLSnowflakeGitHub Actions+3Technology - IN
Principal Forward-Deployed AI & Data Engineer
NewInsight
Melbourne, Victoria🇦🇺Hybrid2 hours agoTechnology - MA
Senior Data Engineer - AWS
NewMaltem Australia
Sydney, New South Wales🇦🇺Hybrid5 hours agoSQLAWSAirflow+5Technology