Data Engineer (Ex-Capital One or Ex-Discover Financial)

Mody''''s looking for Data Engineers / Software Engineers with strong experience in Python, PySpark, ETL, and data pipeline development for the Capital One. The selected candidates will design, develop, and maintain scalable data processing solutions and support large-scale data engineering initiatives.

Responsibilities

• Develop and maintain scalable data pipelines using Python and PySpark.
• Build and optimize ETL/ELT processes for large datasets.
• Develop data ingestion, transformation, and integration workflows.
• Work with structured and unstructured data from multiple sources.
• Optimize Spark jobs and data processing performance.
• Develop reusable and reliable data engineering components.
• Troubleshoot pipeline failures and data quality issues.
• Collaborate with Data Scientists, Software Engineers, and Business teams.
• Participate in Agile development, code reviews, testing, and deployment.

Required Skills

• 3+ years of experience in Data Engineering or Software Engineering.
• Strong programming experience with Python.
• Hands-on experience with PySpark / Apache Spark.
• Strong understanding of ETL/ELT and data pipeline development.
• Experience working with SQL and relational databases.
• Experience with data integration and transformation.
• Good understanding of software development practices, Git, testing, and CI/CD.
• Strong problem-solving and communication skills.

Preferred Skills

• Experience with AWS, Azure, or Google Cloud Platform.
• Experience with Snowflake, Databricks, Hadoop, Kafka, or Airflow.
• Knowledge of cloud-based data platforms.
• Experience with Docker and Kubernetes.
• Experience working in Agile/Scrum environments.