Quick Overview
Work Type
Hybrid
Level
Mid Senior
Job Description
Job Title: Senior Data Engineer
Location: Plano, TX
Experience Required: 10+ Years
Job SummaryWe are seeking a highly skilled Senior Data Engineer with 10+ years of experience in designing, developing, and maintaining enterprise-scale data solutions. The ideal candidate will have strong expertise in data warehousing, ETL/ELT development, cloud platforms, big data technologies, and data modeling. The candidate will play a key role in building scalable data pipelines and supporting analytics, reporting, and AI/ML initiatives.
Key Responsibilities
- Design, develop, and optimize large-scale data pipelines and ETL/ELT processes.
- Build and maintain data warehouses, data lakes, and lakehouse architectures.
- Develop scalable solutions for batch and real-time data processing.
- Collaborate with business stakeholders, architects, data scientists, and analysts to gather requirements and deliver data solutions.
- Implement data quality, governance, security, and compliance standards.
- Optimize database performance, query tuning, and data processing workflows.
- Develop and maintain data models, metadata, and technical documentation.
- Monitor and troubleshoot production data pipelines and resolve performance bottlenecks.
- Mentor junior engineers and promote best practices in data engineering.
- Support cloud migration and modernization initiatives.
Required Skills
- Strong expertise in SQL and Python.
- Hands-on experience with Apache Spark, Kafka, Hadoop, and distributed data processing frameworks.
- Extensive experience with ETL/ELT tools such as Informatica, Talend, SSIS, Airflow, or dbt.
- Experience with cloud platforms (AWS, Azure, or Google Cloud Platform).
- Strong knowledge of Snowflake, Redshift, BigQuery, Synapse, or similar data warehouse technologies.
- Expertise in data modeling, data architecture, and database design.
- Experience with real-time streaming and event-driven architectures.
- Knowledge of CI/CD pipelines, Git, and DevOps practices.
- Strong understanding of data governance, security, and compliance standards.
Preferred Qualifications
- Experience with Databricks and Delta Lake.
- Exposure to AI/ML data pipelines and MLOps.
- Experience with Terraform or Infrastructure as Code (IaC).
- Cloud certifications (AWS, Azure, or Google Cloud Platform).
- Experience working in Agile/Scrum environments.
Education
- Bachelor''s or Master''s degree in Computer Science, Information Technology, Engineering, or a related field.
Skills
SQL
AWS
ETL
MLOps
Scrum
Snowflake
Agile
Airflow
Apache
Apache Spark
Azure
BigQuery
Databricks
Git
Google Cloud
Hadoop
Kafka
Python
Redshift
Terraform
dbt
Similar jobs
Senior Databricks Data Engineer / Platform Consultant - Remote
QTech US Inc · United States
9 minutes agoData Engineer
Stefanini · Wilmington, United States
21 minutes agoData Manager / Curator
Chenega MIOS · Arlington, United States
23 minutes agoData Engineer - Hybrid
MSYS Inc. · Raleigh, United States
31 minutes agoData Engineer
Innosoul inc · Raleigh, United States
31 minutes agoAWS Lead Data Engineer
Cloudious · United States
50 minutes ago