Quick Overview
Job Description
Role: API Data Engineer
Location : New York, NY or Fort Mill, SC Hybrid
Job Responsibilities:
10+ years of experience in software/data engineering, API development, or cloud platform engineering
Work with development teams and stakeholders to deliver technical solutions that enable business capabilities
Design and develop data applications using big data technologies (AWS, Spark) to ingest, process, and analyze large disparate datasets
Build robust data pipelines on the cloud using AWS Glue, Confluent Kafka, Aurora Postgres, EKS, PySpark, Lambda, and Snowflake
Build REST-based data APIs using Python/C#, EKS, and Lambda
Build infrastructure for optimal ETL from various data sources using SQL and AWS big data technologies
Work with data and analytics experts to improve functionality in data systems
Implement architectures to handle large-scale data and its organization
Execute data design and architecture strategies aligned with enterprise standards
Deliver reference architectures outlining principles and best practices for technology advancement
Design and maintain Terraform-based infrastructure using modular patterns, private module registries, and multi-environment state management
Build and maintain GitHub Actions, Octopus , Liquibase CI/CD pipelines for API, data, and infrastructure delivery — including PR validation, Terraform plan gates, and environment promotion
Implement reusable GitHub workflow patterns and integrate with enterprise DevSecOps shared workflows for build, test, deploy, and rollback
Instrument services with Dynatrace for distributed tracing, metrics, and production observability on Lambda and containerized workloads
Define monitoring, alerting, and SLOs in Dynatrace; use APM data for performance tuning, incident response, and reliability improvements
Similar jobs
- SE
Data Engineer- Orlando, FL with Security Clearance
NewSerco Inc.
Orlando, FL🇺🇸HybridYesterdaySQLETLAgile+4Technology - CS
W2 Role - AWS Data Engineer- Apache Iceberg & Polaris-Remote
NewCyber Sphere LLC
United States🇺🇸RemoteYesterdayAWSApacheApache SparkTechnology - IC
Data Engineer (Clearance Required)
NewICF Consulting Group, Inc.
Reston, VA🇺🇸$81.5k - $167.6k/yrRemoteYesterdayOracleSQLSQL Server+8Technology - HT
Data Engineer | All Over US | Contract
NewHealthcare Triangle Inc
Irving, TX🇺🇸HybridYesterdaySQLScalaAWS+6Technology - SP
Data Engineer with Security Clearance
NewSPA
Falls Church, VA🇺🇸$120k - $146k/yrHybridYesterdaySQLAWSETL+6Technology - NO
Cleared ETL Data Engineer (Multi-Level) with Security Clearance
NewNoblis
Chantilly, VA🇺🇸$90.7k - $188.7k/yrHybrid2 days agoDockerGCPSQL+12Technology