Haystack
← Back to Jobs
Technology
IN

API Data Engineer

Incedo IncNew York, NY🇺🇸United StatesPosted 3 Sept 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
New York, NY, United States
Posted
Yesterday
SQLAWSETLSnowflakeC#KafkaPythonRESTTerraform

Job Description

Role: API Data Engineer 

Location : New York, NY or Fort Mill, SC Hybrid

 

 

Job Responsibilities: 

  • 10+ years of experience in software/data engineering, API development, or cloud platform engineering 

  • Work with development teams and stakeholders to deliver technical solutions that enable business capabilities 

  • Design and develop data applications using big data technologies (AWS, Spark) to ingest, process, and analyze large disparate datasets 

  • Build robust data pipelines on the cloud using AWS Glue, Confluent Kafka, Aurora Postgres, EKS, PySpark, Lambda, and Snowflake 

  • Build REST-based data APIs using Python/C#, EKS, and Lambda 

  • Build infrastructure for optimal ETL from various data sources using SQL and AWS big data technologies 

  • Work with data and analytics experts to improve functionality in data systems 

  • Implement architectures to handle large-scale data and its organization 

  • Execute data design and architecture strategies aligned with enterprise standards 

  • Deliver reference architectures outlining principles and best practices for technology advancement 

  • Design and maintain Terraform-based infrastructure using modular patterns, private module registries, and multi-environment state management 

  • Build and maintain GitHub Actions, Octopus , Liquibase CI/CD pipelines for API, data, and infrastructure delivery — including PR validation, Terraform plan gates, and environment promotion 

  • Implement reusable GitHub workflow patterns and integrate with enterprise DevSecOps shared workflows for build, test, deploy, and rollback 

  • Instrument services with Dynatrace for distributed tracing, metrics, and production observability on Lambda and containerized workloads 

  • Define monitoring, alerting, and SLOs in Dynatrace; use APM data for performance tuning, incident response, and reliability improvements 

 

Similar jobs