Quick overview
Job description
Primary Skills
- GCP, Big Query, Python, Airflow, SQL, DBT
Job requirements
- About the Role
- We are seeking a Senior Data Engineer with deep expertise in Google Cloud Platform (GCP) and BigQuery to lead cloud modernization initiatives, develop scalable data pipelines, and enable real-time data processing for enterprise-level systems. This is a high-impact role focused on driving the transformation of legacy infrastructure into a robust, cloud-native data ecosystem.
- Key Responsibilities
- 1. Data Migration & Cloud Modernization
- Analyze legacy on-premises and hybrid cloud data warehouse environments (e.g., SQL Server).
- Lead the migration of large-scale datasets to Google BigQuery.
- Design and implement data migration strategies ensuring data quality, integrity, and performance.
- 2. Data Integration & Streaming
- Integrate data from various structured and unstructured sources, including APIs, relational databases, and IoT devices.
- Build real-time streaming pipelines for large-scale ingestion and processing of IoT and telemetry data.
- 3. ETL / Data Pipeline Development
- Modernize and refactor legacy SSIS packages into cloud-native ETL pipelines.
- Develop scalable, reliable workflows using Apache Airflow, Python, Spark, and GCP-native tools.
- Ensure high-performance data transformation and loading into BigQuery for analytical use cases.
- 4. Programming & Query Optimization
- Write and optimize complex SQL queries, stored procedures, and scheduled jobs within BigQuery.
- Develop modular, reusable transformation scripts using Python, Java, Spark, and SQL.
- Continuously monitor and optimize query performance and cost efficiency in the cloud data environment.
- Required Skills & Experience
- 5+ years in Data Engineering with a strong focus on cloud and big data technologies.
- Minimum 2+ years of hands-on experience with GCP, specifically BigQuery.
- Proven experience migrating on-premise data systems to the cloud.
- Strong development experience with Apache Airflow, Python, and Apache Spark.
- Expertise in streaming data ingestion, particularly in IoT or sensor data environments.
- Strong SQL development skills; experience with BigQuery performance tuning.
- Solid understanding of cloud architecture, data modeling, and data warehouse design.
- Familiarity with Git and CI/CD practices for managing data pipelines.
- Preferred Qualifications
- GCP Professional Data Engineer certification.
- Experience with modern data stack tools like dbt, Kafka, or Terraform.
- Exposure to ML pipelines, analytics engineering, or DataOps/DevOps methodologies.
- Why Join Us?
- Work with cutting-edge technologies in a fast-paced, collaborative environment.
- Lead cloud transformation initiatives at scale.
- Competitive compensation and benefits.
- Remote flexibility and growth opportunities.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- B2
Senior Fabric Lead Data Engineer - R01572945 Auto Apply
Brillio 2 · Bengaluru · Hybrid · Posted 22 Oct 2026 🇮🇳
SQLGitApache Spark+6TechnologySalary not listed - WA
Lead Data EngineerRecently posted Auto Apply
Weekday AI · Delhi · On-site · Posted 16 Nov 2026 🇮🇳
DockerSQLScala+22TechnologySalary not listed - CO

Data EngineerRecently posted Auto Apply
Conga · Bengaluru · Hybrid · Posted 16 Nov 2026 🇮🇳
SQLAWSETL+10TechnologySalary not listed - WE
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekdayworks · Bengaluru · On-site · Posted 16 Nov 2026 🇮🇳
Technology₹1400k - ₹2000k/yr - V1
Senior Oracle Fusion Data Migration ConsultantRecently posted Auto Apply
Version 1 · Bengaluru, KA · Hybrid · Posted 16 Nov 2026 🇮🇳
OraclePL/SQLSQL+6TechnologySalary not listed - WA
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekday AI · Chennai, Tamil Nadu · On-site · Posted 16 Nov 2026 🇮🇳
GCPSQLAirflow+6TechnologySalary not listed - WA
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekday AI · Hyderabad, Telangana · On-site · Posted 16 Nov 2026 🇮🇳
GCPSQLAirflow+6TechnologySalary not listed - WA
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekday AI · Pune, Maharashtra · On-site · Posted 16 Nov 2026 🇮🇳
GCPSQLAirflow+6TechnologySalary not listed - WA
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekday AI · Bengaluru, Karnataka · On-site · Posted 16 Nov 2026 🇮🇳
GCPSQLAirflow+6TechnologySalary not listed - EX
Technical Data managerRecently posted Auto Apply
Excelya · Bengaluru, Karnataka · Hybrid · Posted 16 Nov 2026 🇮🇳
GCPOracleMicrosoft Excel+2TechnologySalary not listed - PA
Data Analyst / Data EngineerRecently posted Auto Apply
Pavago · India · Remote · Posted 13 Nov 2026 🇮🇳
OnboardingSQLMicrosoft Excel+6TechnologySalary not listed - BG
KNIME SpecialistRecently posted Auto Apply
Bosch Group · bengaluru · On-site · Posted 13 Nov 2026 🇮🇳
SQLAWSETL+5TechnologySalary not listed