Data Engineer

HCLTech is a global technology company, home to more than 220,000 people across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services.

Role: Data Engineer

Experience Level Required in Years: 10 - 15 years

Mandatory Required Skills

• Hands-on experience with Quantexa platform / Decision Intelligence
• Strong in Apache Spark / PySpark
• Proficiency in Python / Scala
• Experience in ETL, Data Engineering, Data Warehousing
• Knowledge of entity resolution, graph analytics, link analysis
• Experience working with large datasets (Big Data ecosystem – Hive/HDFS)

Please share the Detailed Job Description

• Design and develop solutions using Quantexa Decision Intelligence Platform
• Build data ingestion, transformation, and ETL pipelines using Spark/PySpark
• Work on entity resolution, network analytics, and graph-based data models
• Integrate multiple structured/unstructured data sources for analytics use cases
• Ensure data quality, validation, and governance standards
• Optimize performance of large-scale data workflows
• Collaborate with business analysts and stakeholders for requirement gathering
• Support deployment, testing, and production release activities
• Work in Agile environment with sprint-based delivery