Haystack
← Back to Jobs
Remote
Temporary/Casual
Technology
IN

Senior ML Engineer | Germany (3 Month project)

InteticsGermany🇩🇪GermanyPosted 11 Sept 2026

Why This Role Stands Out

Leverage your expertise in MLOps and GPU workloads to build cutting-edge production ML infrastructure for a cloud-native project with a German client, offering a flexible remote work arrangement. This engaging, engineering-focused role is perfect for an experienced ML Engineer ready to advance their skills in LLMs, Kubernetes, and CI/CD, so apply today to make a significant impact.

Quick Overview

Seniority
Mid Senior
Employment type
Temporary/Casual
Work mode
Remote
Location
Germany
Posted
5 hours ago
SQLSQL ServerMLOpsMLflowGitLab CIKubernetesLLMPython

Job Description

We are looking for an experienced We are looking for an experienced ML Engineer / MLOps Engineer to join a cloud-native project for a German customer.

The role is strongly engineering-focused and involves building production-grade ML infrastructure, working with GPU workloads, ML pipelines, LLMs and large-scale data processing.

📍 Location: Germany
🗣 German: B2+ - must-have
🗣 English: B1+
📅 Estimated start: September 30, 2026

What you'll be working on

  • Build and orchestrate ML pipelines using Kubeflow Pipelines (KFP v2)
  • Train ML models on GPUs and manage GPU resources within Kubernetes
  • Fine-tune transformers and LLMs
  • Track experiments and models using MLflow
  • Build classical ML models with XGBoost and CatBoost
  • Process large datasets using SQL Server and DuckDB
  • Develop Python-based pipelines, integrations and tooling
  • Maintain high engineering standards through testing, clean code and CI/CD with GitLab CI
  • Work in a secure, zero-trust / secure-by-default environment with network policies and restrictive container permissions

What we're looking for

  • Hands-on experience with Kubeflow Pipelines, ideally KFP v2
  • Experience training models on GPUs
  • Practical experience with LLM / transformer fine-tuning
  • Experience with MLflow
  • Strong knowledge of XGBoost, CatBoost or similar boosting models
  • Strong Python engineering skills
  • Solid SQL experience and understanding of large-scale data processing
  • Experience with CI/CD, clean code and automated testing
  • Production-grade ML/MLOps experience beyond notebook-based experimentation
  • Experience working in enterprise or regulated cloud-native environments

Nice to have

  • Experience with LLM pre-training, beyond fine-tuning
  • GPU orchestration in Kubernetes
  • Experience with zero-trust environments, network policies and restrictive container rights
  • Knowledge of DuckDB
  • Experience with modern Python tooling such as uv

Previous healthcare or billing domain experience is not required, but you should be comfortable quickly getting up to speed with a new domain.

Similar jobs