Back to Jobs
Recently postedFull timeTechnology

Sr Data Engineer

Tech Aalto Pte ltdSydney, Sydney🇦🇺Australia

Quick overview

SeniorityMid Senior
Employment typeFull Time
Work modeHybrid
LocationSydney, Sydney, Australia
SQLGitAWSSnowflakeAirflowApacheGitHub ActionsPythondbt

Job description

Sr Data Engineer

Responsibilities
  • Building and maintaining dbt transformation models across multiple pipeline layers - from raw ingestion through to governed, consumer-ready datasets
  • Writing Snowflake SQL for complex transformations: type casting, deduplication, incremental load logic, surrogate key generation
  • Developing and debugging Apache Airflow DAGs on AWS ECS
  • Contributing to AWS Lambda-based ingestion( Python) - file validation, control file generation, S3 event handling
  • Maintaining source-to-target mapping documentation and aligning models to business requirements anddataspecs
  • Supporting onboarding of downstream consumers viadatasharing mechanisms and event-driven notifications
  • Participating in code reviews, writing YAML-baseddataquality tests, and owning tickets from design through to production
Tech stack required
  • Strong SQL
  • Proficiency with dbt Core
  • Apache Iceberg Table format (Nice to have)
  • Apache Airflow
  • AWS - Working Knowledge of S3, Lambda, MWAA, ECS, Glue Catalogs, Lake Formation, Lambda, SQS, EventBridge
  • Experience with fixed-format or structured financialdatafiles
  • CICD with Github Actions.

Similar jobs