IT - ETL Developer

Job Title: IT - ETL Developer

Duration: 6+ Months - Can be extended

Location: Richfield, MN Hybrid Onsite Interview

Position Summary/Job Description:

Hire an experienced Data Engineer to design, build, and maintain scalable batch/streaming data pipelines on Google Cloud. The role requires deep SQL expertise, production grade orchestration with Apache Airflow (Cloud Composer), and strong Python for ELT/ETL, with exposure to Postgres.

Skills Overview:

What are the top five skills and number of years of experience required to perform this job?

• SQL (5+ years)
• Apache Airflow (Cloud Composer) (3+ years)
• Google Cloud Platform (BigQuery, Dataflow, Pub/Sub, GCS, Composer) (3+ years)
• Python (5+ years)
• Big Data (warehousing/processing concepts, performance)(5+ years)
• Postgres (3+)

Experience

• Design, develop, and operate reliable data pipelines and DAGs using Apache Airflow/Cloud Composer for batch and near real time workflows.
• Build ELT/ETL on Google Cloud Platform services (e.g., BigQuery, Dataflow, Pub/Sub, Cloud Storage; Composer for orchestration); enforce coding, testing, and observability standards.
• Write expert level SQL for modeling, complex transformations, windowing functions, and performance tuning; own query efficiency and cost optimization.
• Develop Python data components (operators, hooks, transforms), packaging and CI/CD for deployment to Composer/Dataflow.
• Work with Big Data ecosystems and MPP warehouses; support data ingestion, schema evolution, and partitioning/clustering strategies.
• Integrate Postgres sources/targets
• Partner with product, analytics, and platform teams; uphold security, compliance, data quality (DQ checks, SLAs), and documentation standards.

What are some preferred/nice to have skills the manager is looking for?

• Who has worked in ads domain.
• Should be able to talk to stakeholders and understand the problem and solve it efficiently
• Preventing data quality issues before they impact users.
• Prioritizing projects and handling multiple requests.

Interview Process Overview:

We will conduct 2 rounds. 1 on Hacker Rank and 1 onsite in MN office