Haystack
← Back to Jobs
Technology
VS

Sr Data Integration Engineer ( & only)

Vertex solutions consultingUnited States🇺🇸United StatesPosted Sep 6, 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
United States
Posted
1 week ago
MongoDBSQLAWSPythonRESTRabbitMQ

Job Description

Role overview
We are looking for a Senior Data Integration Engineer to design, implement and operate reliable integrations between a cloud data platform and an established data-processing application. The role will focus on building production-grade integration solutions, ensuring data consistency, compatibility, traceability and seamless processing across multiple services.
Key responsibilities:
  • Design and implement source-to-application integrations, adapters and data transformation workflows.
  • Develop and maintain batch and change-data processing pipelines using Python and SQL.
  • Work with APIs, XML/JSON and integration services to enable reliable data exchange.
  • Ensure record identity, data consistency and compatibility with existing applications.
  • Implement robust logging, monitoring, retries, error handling and replay mechanisms.
  • Develop automated tests and validate integrations across multiple services.
  • Troubleshoot end-to-end data flows and trace individual records across systems.
  • Evaluate and recommend whether to modify existing applications, introduce adapters, or use shared data models.
  • Collaborate with engineering teams to ensure reliable, maintainable and production-ready integration solutions.
Required skills and qualifications:
  • 9+ years of experience building and operating production-grade data integrations.
  • Strong hands-on experience with Python and SQL.
  • Experience working with REST APIs and data formats such as XML and JSON.
  • Strong understanding of batch processing and change-data processing.
  • Experience developing integration adapters and transformation workflows.
  • Hands-on experience with automated testing, logging, retries and replay mechanisms.
  • Ability to troubleshoot and trace data across multiple services and processing layers.
Must have skills:
  • Python and SQL
  • API and data processing
  • XML/JSON
  • Batch and change-data processing
  • Integration adapters and data transformations
  • Automated testing
  • Error handling, logging, retry and replay
  • Strong understanding of end-to-end data flow and record traceability
Good to have skills:
  • Experience with AWS Cloud services.
  • Hands-on experience with RabbitMQ.
  • Experience with MongoDB and Solr.
  • Knowledge of cloud-based data platforms and distributed systems.
  • Familiarity with CI/CD and DevOps practices.
Desired attributes:
  • Strong problem-solving and troubleshooting skills.
  • Ability to make sound architectural decisions around adapters, application changes and shared models.
  • Strong focus on data accuracy, reliability and system compatibility.
  • Excellent communication and collaboration skills.
  • Ability to work independently and take end-to-end ownership of integration solutions.
  • Strong engineering mindset with a focus on maintainability, testability and production readines

Similar jobs