Quick overview
SeniorityMid Senior
Work modeHybrid
LocationChennai, India
GCPSQLApache SparkAWSETLSnowflakeAirflowData PipelineHadoopHivedbtAzure
Job description
- The ideal candidate will have strong expertise in Snowflake, Hadoop ecosystem, PySpark, and SQL, and will play a key role in enabling data-driven decision-making across the organization.
- Design, develop, and optimize robust data pipelines using PySpark and SQL.
- Implement and manage data warehousing solutions using Snowflake.
- Work with large-scale data processing frameworks within the Hadoop ecosystem.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.
- Ensure data quality, integrity, and governance across all data platforms.
- Monitor and troubleshoot data pipeline performance and reliability.
- Automate data workflows and implement best practices for data engineering.
- 5+ years of experience in data engineering or related roles.
- Strong hands-on experience with Snowflake including data modeling, performance tuning, and security.
- Knowledge in PySpark for distributed data processing.
- Solid understanding of Hadoop ecosystem (HDFS, Hive, Spark, etc.).
- Advanced SQL skills for data manipulation and analysis.
- Experience with ETL tools and orchestration frameworks (e.g., Airflow, DBT).
- Familiarity with cloud platforms (AWS, Azure, or GCP) is a plus.
- Excellent problem-solving and communication skills.
Similar jobs
- CH
Process Lead / Assistant Manager - Environmental compliance
Clean Harbors · Hyderabad · Hybrid 🇮🇳
Stakeholder ManagementComplianceContinuous Improvement+4AdministrativeSalary not listed - CS
Executive Assistant| Mumbai
CSB · Mumbai · Hybrid 🇮🇳
AdministrativeSalary not listed - EX

4771104-Lead Assistant Manager
EXL · Noida · Hybrid 🇮🇳
OnboardingMicrosoft ExcelContinuous Improvement+1AdministrativeSalary not listed - EX

Assistant Manager - Healthcare Line Compliance
EXL · Chennai · Hybrid 🇮🇳
ComplianceRisk AssessmentAdministrativeSalary not listed - EX

Assistant Manager Convex MGA
EXL · Noida · Hybrid 🇮🇳
AdministrativeSalary not listed - EX

Assistant Manager
EXL · Hyderabad · Hybrid 🇮🇳
GCPSQLGit+8AdministrativeSalary not listed - EX

Lead Assistant Manager - Coding Auditor
EXL · Chennai · Hybrid 🇮🇳
Stakeholder ManagementAuditingCompliance+4AdministrativeSalary not listed - EX

Lead Assistant Manager - Datamining
EXL · Hyderabad · Hybrid 🇮🇳
AuditingAdministrativeSalary not listed - EX

Assistant Manager - Business Analyst
EXL · Chennai · On-site 🇮🇳
Stakeholder ManagementMongoDBOracle+18AdministrativeSalary not listed - EX

Lead Assistant Manager - Executive Assistant
EXL · Chennai · Hybrid 🇮🇳
Stakeholder ManagementMicrosoft ExcelMicrosoft Office+4AdministrativeSalary not listed - EX

Senior Assistant Vice President
EXL · Gurugram · Hybrid 🇮🇳
Data AnalysisAdministrativeSalary not listed - EX

Lead Assistant Manager_EU Reporting
EXL · Noida · On-site 🇮🇳
OracleMicrosoft ExcelMicrosoft Office+8AdministrativeSalary not listed