Start searching
Back to Jobs
Full timeTechnology

Senior Software Engineer, Machine Learning

Mary TechnologySydney, New South Wales🇦🇺Australia

Why this role stands out

Advance your career by shaping the future of legal technology with cutting-edge AI at Mary Technology, where you'll build and deploy advanced machine learning models. This hybrid role is perfect for driven engineers passionate about innovation and eager to make a significant impact in a rapidly growing, well-funded company. Apply today to join a collaborative team and redefine how legal professionals work with data.

Quick overview

SeniorityMid Senior
Employment typeFull Time
Work modeHybrid
LocationSydney, New South Wales, Australia
Machine LearningLESSLLMPyTorch

Job description

About Us

At Mary Technology, we're tackling one of the legal industry's biggest challenges: Fact Chaos - the overwhelming disorder that arises from managing mountains of unstructured information. We're building intuitive, scalable tools that help lawyers spend less time untangling facts and more time on high-value thinking. From visualising case timelines to extracting key insights from documents, we're reimagining what legal work looks like. We're backed by $2.7M in funding, growing over 30% MoM, and working with some of the largest law firms in Australia and 50+ mid-tier firms. If you're excited by AI, legal tech, and solving real-world problems at scale-we want to hear from you.

The Role

We're looking for a Senior Machine Learning Software Engineer to drive forward both research and implementation. You'll be working on cutting-edge models and infrastructure that transform how legal professionals interact with data.

You'll fine-tune and deploy production-grade transformer models, build simulation environments for synthetic data, and design scalable inference systems - all while working closely with a high-performing, curious team.

Your Impact

  • Fine-tune and iterate on transformer-based models - LLMs, embedding models, cross-encoders, and other components of modern LLM pipelines.

  • Build scalable, low-latency inference systems with monitoring, optimisation, and dynamic scaling.

  • Design synthetic data pipelines and Gym-style simulation environments to support model evaluation.

  • Lead experimental ML initiatives that drive product innovation and long-term value.

  • Help shape the foundational systems for Legal AGI.

What We're Looking For

  • Experience training and iterating on production transformer models and LLM pipelines.

  • Hands-on expertise with PyTorch, high-level ML frameworks, and inference engines (e.g. vLLM, SGLang, TensorRT).

  • Profound grasp of the forefront of ML and LLMs, from weight quantisation to the nuances between MLA and GQA.

  • Self-motivated learner who stays current with ML research and contributes to team knowledge sharing.

What We Value

  • Agency - You move decisively through ambiguity and take full ownership.

  • Taste - You have a sharp eye for quality across research investments, product, and engineering.

  • Craft Obsession - You're energised by solving hard problems and continuously levelling up your work.

Why Join Us?

  • Career growth - Join early and grow with us in a fast-scaling, high-impact environment.

  • Direct impact - Work closely with founders, legal experts, and engineers to shape the future of legal AI.

  • Equity - Share in our success with meaningful ownership in the company.

  • Purposeful work - Build technology that transforms how the legal industry works from the ground up.

Similar jobs

Apply