Data Engineer

Data Engineer

We are looking for an experienced Data Engineer to design, develop, and maintain scalable data pipelines and data processing solutions. The ideal candidate will have strong experience with cloud data platforms, ETL/ELT, SQL, Python, and modern data engineering technologies.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines.
• Build and optimize data ingestion and transformation processes.
• Develop data solutions using Python, SQL, and PySpark.
• Work with structured and unstructured data from multiple sources.
• Implement data quality, validation, monitoring, and error-handling processes.
• Develop and optimize data models for analytics and reporting.
• Work with cloud-based data platforms and storage solutions.
• Collaborate with Data Scientists, BI Developers, Software Engineers, and business teams.
• Optimize queries, pipelines, and data processing jobs for performance and scalability.
• Implement data security, governance, and access-control best practices.
• Troubleshoot production data pipeline issues and provide root-cause analysis.
• Participate in Agile/Scrum ceremonies and contribute to technical documentation.

Required Skills

• 5+ years of experience in Data Engineering.
• Strong experience with Python and SQL.
• Experience developing ETL/ELT pipelines.
• Strong knowledge of Apache Spark / PySpark.
• Experience with AWS, Azure, or Google Cloud Platform.
• Experience with data warehouses such as Snowflake, Databricks, Redshift, BigQuery, or Azure Synapse.
• Experience with Apache Kafka or other messaging/streaming technologies.
• Knowledge of relational and NoSQL databases.
• Experience with Git, CI/CD, and DevOps practices.
• Strong understanding of data modeling, data architecture, and database performance tuning.

Preferred Skills

• Experience with Databricks, Delta Lake, or Apache Airflow.
• Experience with Kafka, Flink, or real-time data processing.
• Knowledge of dbt and modern data stack technologies.
• Experience with Docker/Kubernetes.
• Experience working with large-scale distributed data systems.
• Knowledge of data governance and cloud security.
• Experience in Agile development environments.