Haystack
← Back to Jobs
Technology
AI

OBSv2 to AWS S3 Migration Platform Engineer

Atlantis IT Consulting Group LLCDallas, TX🇺🇸United StatesPosted Oct 22, 2026

Quick Overview

Seniority
Mid Senior
Work mode
On Site
Location
Dallas, TX, United States
Posted
20 hours ago
DynamoDBAWSPythonCI/CDIAM

Job Description

DAY 1 ONSITE OPPORTUNITY

Role Summary:

  • Lead the design, build, and operation of a secure, scalable migration platform to move object data from OBSv2 to AWS S3.
  • The role focuses on reliable execution, automation, governance, monitoring, and production support for large scale enterprise data migration.

Key Responsibilities

  • Own the end-to-end migration workflow from OBSv2 source buckets to AWS S3 destination buckets.
  • Build and operate AWS-based orchestration using Step Functions, Lambda, Fargate, AWS Batch, DynamoDB, SQS, and rclone.
  • Support both manifest-based and dynamic migration approaches, including batching, sharding, task sizing, and retry handling.
  • Implement governance for bandwidth allocation, queue management, prioritisation, throttling, and job tracking.
  • Build observability through CloudWatch dashboards, logs, metrics, alerts, health checks, and progress reporting.
  • Support secure multi-account deployment, IAM controls, privacy safeguards, testing, performance tuning, and production cutover.
  • Expected Deliverables   · Production-ready migration orchestration platform supporting both manifest and no-manifest paths.
  • Hub-side governance for bandwidth control, queue processing, throttling, and completion reporting.
  • Reusable rclone-based migration runtime with progress reporting and dynamic throttle support.
  • DynamoDB-backed job, task, queue, bandwidth, and summary state management.
  • CloudWatch dashboards, alarms, logs, runbooks, deployment automation, and operational documentation.

Preferred Experience

  • Experience with Dell ECS, OBSv2, or other S3-compatible enterprise object storage platforms.
  • Experience delivering enterprise-scale migrations in regulated, production environments.
  • Experience with hub-and-spoke operating models across multiple AWS accounts.
  • Ability to produce clear technical documentation and leadership-ready reporting.

Mandatory Technical Skills

  • AWS Serverless
  • AWS Compute and Containers
  • AWS Storage
  • Object Storage Migration
  • Python Development
  • DynamoDB
  • Networking
  • IAM and Security
  • Observability
  • CI/CD and Deployment

Similar jobs