Quick overview
SeniorityMid Senior
Work modeHybrid
LocationHyderabad, India
GCPSQLGitETLAirflowBigQueryData PipelineGoogle CloudPythonReconciliationdbt
Job description
Data Engineering
- SQL
- Data Warehousing Concepts
- ETL/ELT Development
- Data Validation and Reconciliation
- Data Pipeline Development
Cloud Technologies
- Google Cloud Platform (GCP)
- BigQuery
- Cloud Storage
- Cloud Composer (Airflow)
Development Tools
- DBT (Data Build Tool)
- Git/GitHub
- Python (Basic to Intermediate)
SAS Knowledge
- Understanding of SAS datasets
- PROC SQL
- SAS ETL concepts
- SAS code analysis
Data Modeling Understanding
- Star Schema
- Dimension and Fact Tables
- Source-to-Target Mapping
- Data Lineage Concepts
SAS Migration Support
- Analyze SAS programs, PROC SQL code, and SAS datasets.
- Assist in converting SAS transformation logic into DBT models and SQL transformations.
- Support migration of data from legacy SAS environments to GCP.
- Participate in code conversion, testing, and reconciliation activities.
Data Pipeline Development
- Develop and maintain ELT pipelines using DBT and BigQuery.
- Build reusable transformation models following DBT best practices.
- Implement data ingestion and processing workflows.
- Support batch and incremental data processing requirements.
Data Transformation & Modeling
- Develop SQL-based transformations for Bronze, Silver, and Gold layers.
- Implement business rules and data quality validations.
- Support dimensional models, fact tables, and dimension tables.
- Assist Data Modelers and Architects in implementing target-state data models.
Data Quality & Testing
- Perform source-to-target validation and reconciliation.
- Support automated testing using DBT tests.
- Investigate and resolve data quality issues.
- Ensure completeness, accuracy, and consistency of migrated data.
GCP Development
- Work with GCP services including:
- BigQuery
- Cloud Storage
- Dataproc
- Cloud Composer (Airflow)
Graduate in Computer Science, Data Science, or related field. 2-3 years of experience in data engineering or related field.
Similar jobs
- AD
Assistant Manager - Module MaintenanceRecently posted
Adani · Mundra · Hybrid 🇮🇳
RoboticsContinuous ImprovementSAPAdministrativeSalary not listed - AD
Assistant Manager - Cell MaintenanceRecently posted
Adani · Mundra · Hybrid 🇮🇳
ComplianceContinuous ImprovementProcess ImprovementAdministrativeSalary not listed - AD
Assistant Manager - EHSRecently posted
Adani · Bongaigaon · Hybrid 🇮🇳
ComplianceProcurementRegulatory Compliance+2AdministrativeSalary not listed - AD
Assistant ManagerRecently posted
Adani · Ahmedabad · Hybrid 🇮🇳
SCADAPenetration TestingAdministrativeSalary not listed - AD
Assistant Manager - Projects - PipelineRecently posted
Adani · Faridabad · Hybrid 🇮🇳
ComplianceContinuous ImprovementTechnical Support+1AdministrativeSalary not listed - AD
Assistant Manager-Guest RelationsRecently posted
Adani · Mumbai · Hybrid 🇮🇳
ComplianceContinuous ImprovementPublic RelationsAdministrativeSalary not listed - AD
Assistant Manager - SecurityRecently posted
Adani · Mundra · Hybrid 🇮🇳
AdministrativeSalary not listed - AD
Assistant Manager - Operation & MaintenanceRecently posted
Adani · Mundra · Hybrid 🇮🇳
ComplianceProcess ImprovementRoot Cause Analysis+1AdministrativeSalary not listed - AD
Assistant Manager – CHP OperationsRecently posted
Adani · Korba · Hybrid 🇮🇳
ComplianceBusiness DevelopmentAdministrativeSalary not listed - AD
Assistant Manager - ABEXRecently posted
Adani · Ahmedabad · Hybrid 🇮🇳
SAPAdministrativeSalary not listed - AD
Assistant Manager - EHSRecently posted
Adani · Amravati · Hybrid 🇮🇳
ComplianceProcurementRegulatory Compliance+2AdministrativeSalary not listed - AD
Assistant Manager - Mechanical Projects - Turbine & Aux
Adani · Waidhan · Hybrid 🇮🇳
Stakeholder ManagementComplianceRoot Cause AnalysisAdministrativeSalary not listed
