Data Engineer with AI

Job Summary

We are seeking a Data Engineer with AI having 5+ years of experience in designing, building, and maintaining scalable data pipelines while supporting AI/ML and Generative AI solutions. The ideal candidate should have strong expertise in data engineering, cloud platforms, Python, SQL, and modern AI technologies.

Required Skills

• 5+ years of experience in Data Engineering.
• Strong proficiency in Python and SQL.
• Experience with Apache Spark or PySpark.
• Hands-on experience with ETL/ELT pipelines and workflow orchestration (Airflow, ADF, etc.).
• Experience with cloud platforms (Azure, AWS, or Google Cloud Platform).
• Strong knowledge of Data Lakes, Data Warehouses, and Snowflake, Databricks, or BigQuery.
• Experience integrating AI/ML or Generative AI solutions into data platforms.
• Familiarity with LLMs, RAG, Vector Databases, or Azure OpenAI/AWS Bedrock is preferred.
• Experience with Git, CI/CD, and DevOps practices.
• Excellent analytical and problem-solving skills.

Responsibilities

• Design and develop scalable data pipelines for structured and unstructured data.
• Build and optimize ETL/ELT workflows for enterprise data platforms.
• Support AI/ML and Generative AI applications by preparing and managing high-quality datasets.
• Collaborate with data scientists and AI engineers to deploy AI solutions.
• Optimize data processing performance using Spark/PySpark.
• Ensure data quality, governance, security, and reliability.
• Monitor and troubleshoot production data pipelines.