Full time

Technology

Platform Engineer - Sydney, NSW

The HR AllySydney, New South Wales🇦🇺AustraliaPosted 27 Jul 2026

Why This Role Stands Out

Advance your career in data platform engineering with The HR Ally, a role offering significant growth and the chance to shape critical data infrastructure. You'll thrive here if you're a mid-senior engineer eager to hone your skills in Cloudera, Kafka, Databricks, and cloud technologies within a flexible hybrid environment. This is an excellent opportunity to contribute to a dynamic team and build a robust career.

Quick Overview

Work Type

Hybrid

Schedule

Full Time

Level

Mid Senior

Job Description

Location: Sydney, NSW
Employment Type: Full-time

Key Responsibilities

Administer and maintain Cloudera Data Platform environments.
Manage Kafka clusters for performance, scalability, and reliability.
Support and optimize Databricks and Spark workloads.
Design and maintain Iceberg-based Lakehouse architectures.
Develop Infrastructure as Code using Terraform and Ansible.
Automate operational tasks using Bash and Python scripting.
Troubleshoot Spark/PySpark jobs and optimize platform performance.
Support Azure Synapse and cloud-based data platforms.
Manage Kubernetes-based containerized environments.
Tune Hive, Impala, and Trino queries for optimal performance.
Collaborate with engineering teams to ensure platform stability and security.

Required Skills

Cloudera Platform Administration
Kafka Cluster Administration
Databricks
Apache Iceberg & Lakehouse Architecture
Azure Synapse
Terraform & Ansible
Bash & Python scripting
PySpark
Spark troubleshooting
Kubernetes
SQL
Hive, Impala & Trino performance tuning

Nice to Have

IDMC Administration
Ataccama Data Quality / MDM
Jenkins & GitHub CI/CD
Cloud PostgreSQL Administration

Eligibility

Australian Citizens or Permanent Residents (PR) only.

Skills

SQL

Ansible

Apache

Azure

Bash

Databricks

Hive

Jenkins

Kafka

Kubernetes

PostgreSQL

Python

Terraform

Similar jobs

Apply now