Quick overview
Job description
Responsibilities:
- Lead and manage a team of data engineers, providing guidance, mentoring, and support to ensure successful project delivery.
- Collaborate with stakeholders, including data scientists, analysts, and product managers, to understand data requirements and translate them into technical solutions.
- Design and develop scalable, reliable, and efficient data pipelines and ETL processes to extract, transform, and load data from various sources into data warehouses or data lakes.
- Implement and maintain data governance and data quality frameworks to ensure data accuracy, integrity, and compliance with privacy regulations.
- Optimize data infrastructure and architecture to improve data processing performance and reduce latency.
- Identify and evaluate new technologies, tools, and frameworks to enhance data engineering capabilities and drive innovation.
- Collaborate with infrastructure and operations teams to ensure the availability, reliability, and security of data platforms.
- Define and enforce coding standards, best practices, and development methodologies to ensure high-quality code and maintainable solutions.
- Conduct performance reviews, provide feedback, and support the professional growth and development of team members.
- Stay up-to-date with industry trends, emerging technologies, and advancements in data engineering to drive continuous improvement and innovation within the team.
Qualifications:
- Bachelor's or Master's degree in Computer Science, Information Technology or any other field, preferably from a premium/Tier-1 college or institute/university.
- Proven experience in data engineering, with a focus on designing and implementing data pipelines, ETL processes, and data warehousing solutions.
- Good experience in Azure Data Factory, Data Lake, Azure Synapse,Databricks, building data models/data marts to be used in Power BI
- Skilled in end-to-end ETL/ELT process. with Bigdata eco systems
- Strong Hands-on experience in writing efficient code in Python/Pyspark to manipulate data and draw insights and have used libraries such as - Pandas, Numpy, Matplotlib, modin, Dask, scikit-learn etc.
- A successful history of manipulating, processing and extracting value from large disconnected datasets, including MariaDB, Mongo, Elasticsearch index.
- Familiar with data extraction using third party APIs
- Proficiency in working with relational databases (SQL) and NoSQL databases.
- Excellent problem-solving and analytical skills with the ability to translate complex business requirements into technical solutions.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- SW

Structured Data Engineer - AI Search (Remote, Full-Time) [HR226]Recently posted Auto Apply
Smart Working Solutions · India · Remote · Posted 18 Nov 2026 🇮🇳
SQLGitHTML+7TechnologySalary not listed - BM

AI Data Engineer (Speech & Language)Recently posted Auto Apply
Blue Machines AI · Bengaluru, Karnataka · On-site · Posted 19 Nov 2026 🇮🇳
GitNLPBash+6TechnologySalary not listed - CA

Snowflake Data EngineerRecently posted Auto Apply
Capco · Bengaluru · Hybrid · Posted 19 Nov 2026 🇮🇳
SQLGitETL+13TechnologySalary not listed - WP

Data EngineerRecently posted Auto Apply
WPP · Chennai · Hybrid · Posted 18 Nov 2026 🇮🇳
SQLApache SparkDatabricks+9TechnologySalary not listed - JU

Data Engineer - II (Biometrics)Recently posted Auto Apply
Jumio · Bengaluru · Hybrid · Posted 18 Nov 2026 🇮🇳
SQLAWSETL+5TechnologySalary not listed - CH

Senior Data EngineerRecently posted Auto Apply
Cohere Health · Hyderabad · Hybrid · Posted 17 Nov 2026 🇮🇳
SQLApache SparkAWS+6TechnologySalary not listed - B2
Senior Fabric Lead Data Engineer - R01572945 Auto Apply
Brillio 2 · Bengaluru · Hybrid · Posted 22 Oct 2026 🇮🇳
SQLGitApache Spark+6TechnologySalary not listed - WE
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekdayworks · Bengaluru · On-site · Posted 16 Nov 2026 🇮🇳
Technology₹1400k - ₹2000k/yr - V1
Senior Oracle Fusion Data Migration ConsultantRecently posted Auto Apply
Version 1 · Bengaluru, KA · Hybrid · Posted 16 Nov 2026 🇮🇳
OraclePL/SQLSQL+6TechnologySalary not listed - WA
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekday AI · Chennai, Tamil Nadu · On-site · Posted 16 Nov 2026 🇮🇳
GCPSQLAirflow+6TechnologySalary not listed - WA
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekday AI · Hyderabad, Telangana · On-site · Posted 16 Nov 2026 🇮🇳
GCPSQLAirflow+6TechnologySalary not listed - WA
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekday AI · Pune, Maharashtra · On-site · Posted 16 Nov 2026 🇮🇳
GCPSQLAirflow+6TechnologySalary not listed