Quick Overview
Seniority
Mid Senior
Work mode
On Site
Location
New York, NY, United States
Posted
Yesterday
SQLScalaAirflowAzureGitPython
Job Description
Role: Data Engineer (AI & Data Pod)
Location: NY (Hybrid 3 days a week in the office)
Experience: 8-12 years
Role Summary: Builds and maintains reliable data pipelines and platforms on-site, working with the Data Architect and AI team to deliver high-quality data for analytics and AI solutions.
Key Responsibilities
- Design, build, and optimize batch and streaming data pipelines
- Implement data models and transformations defined by the Data Architect
- Ingest and integrate data from multiple source systems and APIs
- Implement data quality checks, monitoring and alerting
- Optimize performance and cost of data workloads
- Collaborate with AI Developers and analysts to provision datasets
- Maintain documentation, version control and CI/CD for data code
- Work with offshore data engineers on knowledge transfer and delivery
Required Qualifications
- 5+ years in data engineering
- Strong SQL and Python (or Scala) skills
- Experience with orchestration tools such as Airflow or Azure Data Factory
- Hands-on experience with cloud data services and big data frameworks such as Spark
- Understanding of data warehousing and lakehouse concepts
- Familiarity with Git, CI/CD, and infrastructure-as-code
- Experience supporting ML/AI data needs is a plus
Key Skills
SQL | Python | Spark | Airflow / ADF | Cloud data services | CI/CD
Similar jobs
- GD
Data Engineer
NewGDH
United States🇺🇸$62 - $74/hrRemoteYesterdaySQLETLSnowflake+2Technology - JG
Senior Data Engineer - Power BI / Snowflake
NewJudge Group, Inc.
Shorewood Hills, WI🇺🇸HybridYesterdaySQLSnowflakePower BITechnology - MA
Staff Data Engineer
NewAuto ApplyMeeru AI Inc
Pleasanton, California🇺🇸Hybrid6 hours agoGCPMySQLOracle+21Technology - BC
Senior Data Engineer
NewAuto ApplyBitful Consulting
Wadsworth, Ohio🇺🇸Remote7 hours agoOracleSQLETL+6Technology - BC
Senior Data Engineer
NewAuto ApplyBitful Consulting
Tampa, Florida🇺🇸Remote7 hours agoOracleSQLETL+6Technology - BC
Senior Data Engineer
NewAuto ApplyBitful Consulting
Pittsburgh, Pennsylvania🇺🇸Remote7 hours agoOracleSQLETL+6Technology - BC
Senior Data Engineer
NewAuto ApplyBitful Consulting
Florida🇺🇸Remote7 hours agoOracleSQLETL+6Technology - JE
Data Engineer
NewAuto ApplyJenzabar
United States🇺🇸Remote8 hours agoSQLSQL ServerETL+9Technology - QT
Data Engineer – AI/ML
NewQUANTUM TECHNOLOGIES LLC
Dallas, TX🇺🇸$83/hrHybridYesterdayETLMLOpsMachine Learning+2Technology - PG
Data Engineer Databricks, SQL, Python | Hybrid - 70763
NewPRIMUS Global Services Inc.
Menlo Park, CA🇺🇸HybridYesterdaySQLETLData Pipeline+2Technology - SG
AI Data Engineer
NewSoftware Guidance & Assistance
Rockville, MD🇺🇸On-siteYesterdayLLMPythonTechnology - AM
Lead Data Engineer
NewAmpacity
Atlanta, GA🇺🇸$120k - $130k/yrHybridYesterdayOracleSQLETL+6Technology