Start searching
Back to Jobs
Recently postedFull timeTechnology

Quantexa Data Engineer

NixilSydney, Sydney🇦🇺Australia

Quick overview

SeniorityMid Senior
Employment typeFull Time
Work modeHybrid
LocationSydney, Sydney, Australia
Stakeholder ManagementGCPSQLScalaGitApache SparkAWSApacheAzureCI/CD

Job description

  • Contract: 6-12 months, with potential extensions (subject to confirmation).
  • Locations: Melbourne, Sydney or Canberra.
  • Work arrangement: Hybrid.

Join a global IT services and consulting organisation delivering enterprise-scale data and decision intelligence solutions.

We are seeking an experienced Quantexa Data Engineer with strong hands-on experience in Quantexa implementations, Scala, Apache Spark and SQL to design, develop and optimise enterprise data pipelines.

This is an opportunity to contribute to a major data and decision intelligence programme, integrating complex datasets, enabling entity resolution and delivering reliable, high-performance data solutions that support risk, compliance and business decision-making.

Key Responsibilities
  • Design, develop and maintain data pipelines to ingest, transform and integrate data from multiple internal and external sources.
  • Configure and support Quantexa data models, entity resolution, record matching and network generation.
  • Develop scalable data processing solutions using Scala, Apache Spark and SQL.
  • Perform data cleansing, standardisation, validation and reconciliation across complex, high-volume datasets.
  • Optimise data pipelines for performance, scalability and reliability.
  • Troubleshoot data quality issues, pipeline failures and integration challenges.
  • Implement data quality, lineage, governance and access controls.
  • Support testing, production deployments, release management and ongoing platform maintenance.
  • Collaborate with solution architects, business analysts, data specialists and governance teams.
Essential Skills & Experience
  • Australian Government baseline, NV1 or NV2 security clearance or eligibility to obtain one, particularly for Canberra-based opportunities.
  • ONLY open to Australian Citizens.
  • Proven hands-on Quantexa implementation experience as a Data Engineer or Developer, rather than solely consuming Quantexa outputs.
  • Strong Scala and Apache Spark experience in large-scale distributed data processing.
  • Advanced SQL skills for data querying, transformation and troubleshooting.
  • Solid commercial experience developing and maintaining production-grade data pipelines.
  • Strong understanding of data modelling, mapping, transformation and integration across multiple source systems.
  • Experience with entity resolution, record matching, deduplication and entity linking.
  • Proven experience delivering enterprise data solutions into production.
  • Strong troubleshooting, analytical, communication and stakeholder engagement skills.
Highly Desirable
  • Quantexa certification or experience delivering solutions through a Quantexa partner.
  • Experience in financial services, financial crime, fraud, AML, risk or compliance.
  • Knowledge of network analytics and graph-based data solutions.
  • Experience with AWS, Azure or GCP, Elasticsearch, Git and CI/CD pipelines.
  • Understanding of data governance, lineage, provenance and data quality frameworks.
  • Experience working in government or regulated enterprise environments.

Similar jobs

Apply