Haystack
← Back to Jobs
Full time
Technology
TH

Senior Data Engineer - Real-Time AWS

The HR AllySydney, Sydney🇦🇺AustraliaPosted 19 Jul 2026

Why This Role Stands Out

This hybrid role at The HR Ally offers a fantastic opportunity to shape enterprise-scale real-time data platforms on AWS, utilizing cutting-edge technologies like PySpark and Redshift to drive business insights. You'll thrive here if you have extensive AWS data engineering experience and a passion for building scalable data solutions, with a competitive compensation package and excellent career growth potential. Apply now to join a forward-thinking team and make a significant impact.

Quick Overview

Seniority
Mid Senior
Employment type
Full Time
Work mode
Hybrid
Location
Sydney, Sydney, Australia
DynamoDBMongoDBOracleSQLAWSSnowflakeAirflowApacheCloudFormationGitKafkaPythonRedshiftTerraform

Job Description

Data Engineer Sydney, NSW

We are looking for an experienced Data Engineer (9-14 Years) to join a high-performing team delivering enterprise-scale data platforms and real-time data solutions on AWS.

Must Have Skills
  • AWS Cloud Services
  • Python & PySpark
  • Apache Airflow (MWAA)
  • SQL
  • Amazon Redshift
  • AWS SageMaker Unified Studio
  • AWS Kinesis / Kafka (Real-Time Streaming)
Key Responsibilities
  • Design and develop scalable batch and real-time data ingestion frameworks.
  • Build and optimize data pipelines using AWS services and modern data engineering practices.
  • Develop low-latency streaming solutions using Kinesis, Kafka, or similar technologies.
  • Implement data transformations, orchestration workflows, and monitoring solutions.
  • Work with Data Warehouses, Data Lakes, and Lakehouse architectures.
  • Collaborate with cross-functional teams to deliver robust and scalable data solutions.
Required Experience
  • Strong expertise in AWS, Python, PySpark, Airflow, and Redshift.
  • Hands-on experience with SageMaker Unified Studio.
  • Experience with relational and NoSQL databases (Oracle, MongoDB, DynamoDB, Snowflake, Teradata, etc.).
  • Proven experience building real-time and batch data pipelines.
  • Knowledge of CI/CD, Git, Infrastructure as Code (Terraform/CloudFormation).
  • Data Modelling experience is highly desirable.

Similar jobs

Browse related jobs

Apply now