Quick Overview
Seniority
Mid Senior
Work mode
Hybrid
Location
United States
Posted
Yesterday
SQLAirflowGoogle CloudPython
Job Description
What You'll Do
- Build and maintain the data pipelines that feed ML inference systems running in production.
- Support Data Scientists by supplying, preparing, and validating data during model development (without owning model training).
- Design and operate data processing jobs on Dataflow and Dataproc (Spark) for large-scale transforms.
- Own data lake structure and organization in Cloud Storage to support downstream ML and inference consumers.
- Build and maintain orchestration workflows (Cloud Composer/Airflow) that reliably schedule and monitor pipeline execution.
- Implement data quality checks and testing frameworks across pipelines.
- Contribute to feature engineering pipelines supporting a specific upcoming project (feature store tooling see note below).
Required Experience
- 7+ years of software engineering experience, with 3+ years specifically in data infrastructure.
- Strong, hands-on expertise with Google Cloud Platform's data and ML infrastructure stack: Dataflow, Cloud Storage, Cloud Composer, Dataproc.
- Deep expertise in Spark for large-scale data processing.
- Proficiency in Python and SQL.
- Experience building data quality and testing frameworks.
- Experience with pipeline orchestration tools (Airflow, Dagster).
Preferred / Project-Dependent
There is a specific upcoming project where feature store experience may be required. Confirm current need before screening candidates against this line item.
- Vertex AI Feature Store experience, or strong transferable experience with Feast or Tecton (feature versioning, online/offline serving parity).
- Experience with data versioning tools.
Similar jobs
- ST
AWS Data Engineer - W2 Contract
NewSDVS Technologies LLC
United States🇺🇸RemoteYesterdayAWSETLGenerative AI+2Technology - RT
Data engineer
Reveille Technologies
Santa Clara, CA🇺🇸Hybrid1 week agoSnowflakeDatabricksPower BI+1Technology - EG
ETL Engineer - Java Spring Batch
Eliassen Group
Almont, CO🇺🇸$52 - $57/hrHybrid2 months agoSQLSpringAWS+6Technology - MU
Azure Data Engineer-Fremont, CA (Hybrid/Locals Only)
NewMomento USA LLC
Fremont, CA🇺🇸On-siteYesterdaySQLAWSETL+9Technology - DE
Python Data Engineer
NewDeepData Inc.
New York, NY🇺🇸HybridYesterdaySQLETLNumPy+4Technology - PT
Hiring for HEDIS - Data Engineer :: Remote
NewPropelSys Technologies LLC.
AK🇺🇸RemoteYesterdaySQLScalaETL+6Technology