Data Engineer-NSW

Data Engineer Sydney, NSW

We are looking for an experienced Data Engineer (9-14 Years) to join a high-performing team delivering enterprise-scale data platforms and real-time data solutions on AWS.

Must Have Skills

• AWS Cloud Services
• Python & PySpark
• Apache Airflow (MWAA)
• SQL
• Amazon Redshift
• AWS SageMaker Unified Studio
• AWS Kinesis / Kafka (Real Time Streaming)

Key Responsibilities

• Design and develop scalable batch and real time data ingestion frameworks.
• Build and optimize data pipelines using AWS services and modern data engineering practices.
• Develop low latency streaming solutions using Kinesis, Kafka, or similar technologies.
• Implement data transformations, orchestration workflows, and monitoring solutions.
• Work with Data Warehouses, Data Lakes, and Lakehouse architectures.
• Collaborate with cross-functional teams to deliver robust and scalable data solutions.

Required Experience

• Strong expertise in AWS, Python, PySpark, Airflow, and Redshift.
• Hands on experience with SageMaker Unified Studio.
• Experience with relational and NoSQL databases (Oracle, MongoDB, DynamoDB, Snowflake, Teradata, etc.).
• Proven experience building real time and batch data pipelines.
• Knowledge of CI/CD, Git, Infrastructure as Code (Terraform/CloudFormation).
• Data Modelling experience is highly desirable.