Senior Data Engineer

Role: Senior Data Engineer / Data Engineering Lead
Experience: 12+ Years
Location: Austin, TX
Hybrid

Job Summary

We are seeking a Senior Data Engineer with 12+ years of IT experience and strong expertise in data engineering, cloud data platforms, ETL/ELT development, and large-scale data processing. The candidate will design, build, and optimize reliable data pipelines and scalable data solutions.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines and data integration solutions.

• Build data pipelines using Python, SQL, PySpark, and Apache Spark.

• Develop and optimize data warehouses, data lakes, and lakehouse architectures.

• Work with cloud platforms such as AWS, Azure, or Google Cloud.

• Implement data solutions using Snowflake, Databricks, Redshift, or Azure Synapse.

• Integrate data from multiple sources and ensure data quality, accuracy, and consistency.

• Optimize SQL queries, data models, and pipeline performance.

• Implement data governance, security, monitoring, and access controls.

• Build automated workflows using Airflow, Azure Data Factory, AWS Glue, or similar tools.

• Collaborate with architects, analysts, and business teams; provide technical leadership and mentorship.

Required Skills

• 12+ years of overall IT experience, including substantial hands-on data engineering experience.

• Strong proficiency in Python, SQL, PySpark, and Apache Spark.

• Expertise in ETL/ELT, data integration, data modeling, and data warehousing.

• Experience with cloud platforms: AWS, Azure, or Google Cloud Platform.

• Hands-on experience with Snowflake, Databricks, Redshift, or Synapse.

• Knowledge of relational and NoSQL databases.

• Experience with orchestration tools, Git, CI/CD, and automated testing.

• Strong troubleshooting, communication, and leadership skills.

Preferred Qualifications

• Experience with Kafka, streaming data, and real-time processing.

• Knowledge of Delta Lake, Apache Iceberg, or similar lakehouse technologies.

• Experience with Terraform, Docker, Kubernetes, and data pipeline monitoring.

• Relevant cloud or data engineering certifications.

• Experience working in Agile/Scrum environments.