Why this role stands out
This role offers a fantastic opportunity to be a technical leader in shaping TMGM's high-throughput, real-time data ecosystem, driving innovation in the financial technology space. You'll thrive here if you're a seasoned data engineer eager to architect scalable solutions using cutting-edge technologies like Kafka and ClickHouse, and contribute to a globally recognized brokerage. Apply now to leverage your expertise and grow within a dynamic, hybrid work environment.
Quick overview
Job description
About The Company
TMGM is one of the fastest-growing CFD and Forex brokers in the Asia-Pacific region, trusted by over 150,000 clients globally. With a strong focus on innovation, client satisfaction, and regulatory compliance, we continue to expand our presence across international markets.
About The Role
As a Senior Data Engineer, you will be a technical leader responsible for the architecture, scalability, and reliability of our high-throughput, real-time data ecosystem. You will oversee the evolution of our data infrastructure, leveraging Kafka, RabbitMQ, Airflow, and ClickHouse to power mission-critical financial analytics. Your role is to bridge the gap between complex business requirements and high-performance engineering, ensuring our data pipelines can handle the rigours of real-time financial data processing.
Key Responsibilities:
- Lead the design and evolution of highly scalable, fault-tolerant ETL/ELT pipelines.
- Dive the strategy for real-time messaging and stream processing using Kafka and RabbitMQ to ensure sub-second data availability.
- Act as the subject matter expert for ClickHouse, optimising complex schema designs, indexing strategies, and query performance for large-scale financial datasets.
- Oversee the deployment of data services within cloud environments, implementing advanced security protocols and data governance standards essential for the finance industry.
- Collaborate with senior leadership to align data strategy with business objectives. Mentor data engineers through code reviews and technical guidance.
- Implement advanced monitoring and automated recovery systems to ensure the integrity and quality of high-stakes financial data.
Requirements:
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- Proven experience in data engineering, with a strong background in designing and implementing ETL processes within cloud environments.
- Experience within the Finance or Trading technology sector, with a proven track record of handling real-time market or transactional data.
- Strong programming skills in Python, with experience in developing robust, maintainable, and scalable data processing pipelines.
- Extensive SQL knowledge and experience.
- Excellent problem-solving skills and the ability to work collaboratively in a team environment.
- Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.
- Hybrid working arrangement - 2 Days of remote work per week
- Opportunities for enriching career growth, including exposure to regional contexts
- Complimentary snacks and beverages available in the office pantry
- Healthcare coverage (medical, dental, optical), gym benefits
- Flexibility in smart casual dress code
- Young, vibrant and open work culture
Similar jobs
- XE

Data Engineer - Performance InsightsRecently posted Auto Apply
Xero · AU: Sydney (45 Clarence St) · Hybrid 🇦🇺
SQLSnowflakeXero+1TechnologySalary not listed - QG
Principal Data EngineerRecently posted Auto Apply
Qantas Group · Sydney, New South Wales · On-site 🇦🇺
Stakeholder ManagementSQLAWS+9TechnologySalary not listed - EN
Lead Data EngineerRecently posted Auto Apply
Endava · Melbourne, Victoria · Hybrid 🇦🇺
LinearTechnologySalary not listed - EN
Lead Data EngineerRecently posted Auto Apply
Endava · Sydney, New South Wales · Hybrid 🇦🇺
LinearTechnologySalary not listed - KO
Data Engineer Auto Apply
Kogan · South Melbourne · On-site 🇦🇺
DockerGCPSQL+16TechnologySalary not listed - AG
Senior Data EngineerRecently posted Auto Apply
APM Group · Brisbane, QLD · Hybrid 🇦🇺
Stakeholder ManagementSQLApache Spark+8TechnologySalary not listed - AG
Senior Data EngineerRecently posted Auto Apply
APM Group · Melbourne, VIC · Hybrid 🇦🇺
Stakeholder ManagementSQLApache Spark+8TechnologySalary not listed - AG
Senior Data EngineerRecently posted Auto Apply
APM Group · North Sydney, NSW · Hybrid 🇦🇺
Stakeholder ManagementSQLApache Spark+8TechnologySalary not listed - AG
Senior Data EngineerRecently posted Auto Apply
APM Group · West Perth, WA · Hybrid 🇦🇺
Stakeholder ManagementSQLApache Spark+8TechnologySalary not listed - NA

GCP Data Engineer - Contract or Perm Auto Apply
NCS Australia · Sydney, NSW · Hybrid 🇦🇺
GCPGoogle CloudBigQuery+1TechnologySalary not listed - UT

Senior Databricks Consulting Engineer Auto Apply
Ultra Tendency · Sydney · Hybrid 🇦🇺
Stakeholder ManagementMicroservicesSQL+20EngineeringSalary not listed - IP

Lead Data Engineering Consultant Auto Apply
Ippon · Melbourne · Hybrid 🇦🇺
AWSETLSnowflake+5Salary not listed