Quick overview
SeniorityMid Senior
Employment typeFull Time
Work modeRemote
LocationAustralia
DockerMicroservicesMySQLSQLAirflowKafkaPandasPythonRabbitMQKubernetes
Job description
- Build and maintain data pipelines and DAG workflows in Airflow
- Prepare and transform data for analytics and business use cases
- Work with ClickHouse and MySQL, optimize queries, and analyze query execution plans
- Integrate with partner services and external data sources via APIs and FTP
- Design and develop microservices for data processing
- Work with high-load systems processing terabytes of data
- Contribute to architecture and propose technical solutions to improve performance and scalability
- 5+ years of professional Python development experience
- Strong SQL skills and hands-on experience with query optimization
- Experience with ClickHouse and/or MySQL
- Experience designing Python frameworks and libraries, as well as profiling and performance optimization
- Experience developing and working with OLAP systems
- Hands-on experience with Airflow, Pandas, Kafka and/or RabbitMQ
- Experience retrieving and processing data via APIs and FTP
- Experience with Docker and Kubernetes
- Ability to independently evaluate and choose technical solutions
- The opportunity to work on large-scale products and contribute to their development
- A flexible work environment built on autonomy, ownership, and trust, without micromanagement
- The option to work fully remotely or from a modern office
- Medical insurance coverage in countries where the company operates
- An annual $2,000 benefits allowance after the probation period, which can be used for health insurance upgrades, language learning, and sports activities
- Partial reimbursement for professional training, courses, and participation in industry conferences
- Access to a corporate digital library
- Company-funded weekly online sessions with a psychologist
- Relocation opportunities to countries where the company has offices, with relocation assistance available after the probation period, subject to approval
Similar jobs
- IN
Senior Data Engineer: AI-Enhanced Data PipelinesRecently posted
Investa · Sydney · Hybrid 🇦🇺
SQLDatabricksPython+2TechnologySalary not listed - AC
Data Engineer - Azure DatabricksRecently posted
AC3 · Sydney · Hybrid 🇦🇺
OracleSQLETL+6TechnologyA$1.1k - A$1.2k/mo - QA
Principal Data EngineerRecently posted
Qantas · Sydney · Hybrid 🇦🇺
Stakeholder ManagementSQLAWS+9TechnologySalary not listed - QA
Principal Data Engineer - Hybrid, Travel BenefitsRecently posted
Qantas · Sydney · Hybrid 🇦🇺
TechnologySalary not listed - AC
Azure Databricks Data Engineer - Hybrid Sydney CBDRecently posted
AC3 · Sydney · Hybrid 🇦🇺
SQLDatabricksPython+1TechnologySalary not listed - IN
Senior Data EngineerRecently posted
Investa · Sydney · Hybrid 🇦🇺
SQLGitApache Spark+9TechnologySalary not listed - WG
Principal Engineer Data and AIRecently posted Auto Apply
Westpac Group · Sydney · Hybrid 🇦🇺
GitAWSTerraform+7TechnologySalary not listed - WG
Senior Engineer Data and AIRecently posted Auto Apply
Westpac Group · Sydney · Hybrid 🇦🇺
GCPSpringSpring Boot+14EngineeringSalary not listed - WG
Engineer Data and AIRecently posted Auto Apply
Westpac Group · Sydney · Hybrid 🇦🇺
SQLGitAWS+15EngineeringSalary not listed - NA
GCP Principal Data Engineer (Google Cloud)Recently posted
NCS Australia · Sydney · Hybrid 🇦🇺
DockerGCPGit+14TechnologySalary not listed - XS
Senior Data Engineer: Informatica IDMC/IICS & ADF ExpertRecently posted
XPT Software Australia Pty Ltd · Sydney · Hybrid 🇦🇺
OraclePL/SQLSQL+3TechnologySalary not listed - XE
Data Engineer - Performance InsightsRecently posted
Xero · Sydney · Remote 🇦🇺
SQLSnowflakedbtTechnologySalary not listed