Haystack
← Back to Jobs
Technology

Data Platform Engineer

DNI Delaware Nation IndustriesWashington, DC🇺🇸United StatesPosted 14 Aug 2026

Quick Overview

Work Type
Hybrid
Level
Mid Senior

Job Description

Platform Architecture:
  • Design and maintain scalable, cloud-native data platforms, including data lakes, lake houses, and data warehouses (e.g., AWS, Azure, Google Cloud Platform).

Self-Service Enablement:
  • Build reusable CI/CD templates and Infrastructure as Code to allow data scientists and analysts to provision environments and build pipelines independently.
  • Develop robust ETL and ELT frameworks for both batch and streaming data.
    Implement strict role-based access controls, data encryption, data lineage tracking, and compliance frameworks to protect sensitive digital health or enterprise data.
  • Monitor platform performance, storage use, and query responsiveness to ensure high availability and cost efficiency. Collaborate with Data Architects, Software Developers, and Data Scientists to integrate RESTful APIs and deliver cohesive end-to-end data products.

Requirements
  • Bachelor's or Master's degree in Computer Science, Software Engineering, or a related technical field.
  • Minimum 4 years in data engineering, platform engineering, or a highly technical DevOps or data role.
  • Proficiency in Python, Java, or Scala; advanced SQL skills; and experience with NoSQL and distributed database systems.
  • Hands-on experience with data lake and warehouse technologies such as Databricks, Snowflake, Apache Spark, or Apache Kafka.
  • Familiarity with containerization tools (Docker, Kubernetes), workflow orchestration platforms (Airflow, Dagster), and Infrastructure as Code tools (Terraform).
  • Must have a TS/SCI Security clearance

Benefits

Benefits Include:
  • Covers 100% of employee benefit premiums, including Medical (PPO or HDHP Option), Vision, Dental
  • Matching 401K
  • Short- and Long-Term Disability
  • Pet Insurance
  • Professional Development/Education Reimbursement
  • Parking and Transit Benefits for NY, NJ, ATL, and DC Metro areas

Other Duties:

Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities and activities may change at any time with or without notice.

Skills

Docker
SQL
Scala
AWS
ETL
Encryption
Snowflake
Airflow
Apache
Apache Spark
Azure
Databricks
Google Cloud
Java
Kafka
Kubernetes
Python
Terraform

Similar jobs