ETL Developer – Python & Airflow

About the Role

We are seeking a skilled ETL Developer with strong expertise in Python and Apache Airflow  to design, build, and optimize scalable data pipelines. In this role, you will develop production-ready workflows, ensure pipeline reliability, and collaborate with data teams to support business needs.

Responsibilities

·        Develop, test, and deploy Python-based ETL pipelines using Apache Airflow.

·        Write efficient, reusable Python scripts for transformations, validations, and data quality checks.

·        Manage scheduling, orchestration, and monitoring of workflows in Airflow.

·        Collaborate with data engineers and analysts to design pipelines aligned with business requirements.

·        Troubleshoot, optimize, and scale existing ETL jobs.

·        Implement best practices for code quality, testing, and CI/CD integration.

·        Contribute to documentation, observability, and knowledge sharing.

Required Skills

·        Strong experience with Python (pandas, SQLAlchemy, or similar libraries for ETL).

·        Proficiency with Apache Airflow DAG design, task orchestration, and operators.

·        Hands-on experience with dependency/environment management (pipenv, poetry, or conda).

·        Solid knowledge of SQL and relational databases.

·        Understanding of data modeling and transformation patterns (star schema, SCDs, etc.).

·        Familiarity with Git workflows and CI/CD pipelines.

·        Ability to work independently and collaboratively in a fast-paced environment.

Nice to Have

·        Cloud platform experience (AWS, Google Cloud Platform, or Azure) for pipelines and storage.

·        Familiarity with containerization tools (Docker, Kubernetes).

·        Exposure to data warehouses (Snowflake, BigQuery, Redshift).