Data Engineer

Introduction

As a Data Engineer, you will play a crucial role in our team by designing, implementing, and maintaining data pipelines and systems to support our data-driven initiatives. You will work closely with our data scientists and analysts to ensure that data is collected, processed, and stored efficiently.

Responsibilities

• Develop, construct, test, and maintain architectures such as databases and large-scale processing systems.
• Ensure data quality and reliability by implementing data validation and monitoring processes.
• Collaborate with data scientists and analysts to understand their data requirements and provide the necessary infrastructure.
• Design and implement scalable data pipelines for both batch and real-time processing.
• Optimize data workflows for performance and cost-efficiency.
• Troubleshoot data-related issues and provide technical support when needed.
• Stay up-to-date with the latest technologies and trends in data engineering.

Requirements

Required Skills

• Strong programming skills in languages such as Python, Java, or Scala.
• Experience with data modeling, ETL processes, and data warehousing.
• Proficiency in SQL and database management systems.
• Knowledge of big data technologies such as Hadoop, Spark, or Kafka.
• Ability to work with cloud services like AWS, Google Cloud, or Azure.
• Excellent problem-solving and analytical skills.

Preferred Skills

• Experience with machine learning and data analytics.
• Familiarity with data visualization tools like Tableau or Power BI.
• Certifications in data engineering or related fields.
• Good communication and teamwork skills.