Haystack
← Back to Jobs
Technology

Data Platform Engineer

Sradha Technologies LLCCharlotte, NC🇺🇸United StatesPosted 4 Aug 2026

Quick Overview

Work Type
Hybrid
Level
Mid Senior

Job Description

Position Summary

The Developer Experience Engineer is responsible for designing and building the tools, frameworks, APIs, automation, and user experiences that enable engineers to efficiently develop, test, deploy, and operate data pipelines on the Unity Platform. This role serves as the bridge between platform engineering and application development teams, ensuring that Unity capabilities are easy to adopt, well-documented, highly automated, and aligned with enterprise governance standards.

The ideal candidate combines strong software engineering skills with a passion for developer productivity, platform engineering, and user-centric design.

Key Responsibilities

Developer Productivity & Experience

Design and enhance the end-to-end developer experience for Unity Platform users.
Build self-service tooling, SDKs, CLIs, APIs, and templates that simplify pipeline development.
Drive IDE and CAMP integration to streamline pipeline authoring and configuration.
Reduce onboarding friction through automation, reusable patterns, and developer workflows.
Platform Engineering

Develop and maintain platform services supporting Unity''s Control Plane, Governance Engine, Metadata Services, and API ecosystem.
Create reusable framework components and reference implementations for data movement, transformation, orchestration, and governance.
Develop standardized interfaces and tooling around the Unity Universal Job Configuration model.
Automation & Governance

Embed governance, compliance, testing, and security controls into the developer workflow.
Build tooling that enables shift-left validation of data contracts, architecture patterns, and platform policies.
Integrate with enterprise deployment, CI/CD, testing, and architecture governance platforms.
Developer Enablement

Create documentation, tutorials, sample applications, and adoption guides.
Partner with engineering teams to gather feedback and continuously improve platform usability.
Drive developer advocacy and champion adoption of Unity standards and patterns.
Observability & Insights

Build dashboards and tooling that provide insights into platform usage, performance, reliability, and developer productivity.
Leverage metadata and operational telemetry to identify opportunities for optimization and automation.
Required Qualifications

Bachelor''s degree in Computer Science, Engineering, or related field.
5+ years of software engineering experience.
Strong proficiency in:
Java, Python, or Scala
REST APIs and microservices
Git, CI/CD pipelines, and DevOps practices
Cloud-native architectures
Experience building developer tools, frameworks, SDKs, or internal platforms.
Knowledge of distributed data processing technologies such as Spark, Flink, dbt, or similar platforms.
Experience with modern software design patterns and API-first architectures.
Preferred Qualifications

Experience building Internal Developer Platforms (IDP) or platform engineering solutions.
Experience with data engineering ecosystems and enterprise data platforms.
Familiarity with governance-as-code, policy-as-code, and data contracts.
Experience with developer portals, IDE extensions, automation frameworks, or AI-assisted development tools.
Knowledge of Kubernetes/OpenShift, containerization, and cloud-native services.
Experience implementing observability, telemetry, and developer analytics solutions.
Success Measures

Reduction in developer onboarding time.
Increased Unity platform adoption.
Improved developer satisfaction and productivity.
Increased automation of governance and compliance controls.
Reduction in deployment and configuration errors.
Higher reuse of standardized platform patterns and components.
Improved pipeline quality, testing coverage, and operational reliability

Skills

Microservices
Scala
Flink
Git
Java
Kubernetes
Python
REST
Unity
dbt

Similar jobs