Lead Data Engineer

Location: Columbus, OH Salary: $70.00 USD Hourly - $80.00 USD Hourly Description: Lead Data Engineer

• Bachelor's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
• 10+ years of experience in software engineering with significant focus on data engineering and distributed systems.
• Strong programming expertise in Java and Python.
• Experience designing and building enterprise-scale ETL/ELT platforms.
• Deep understanding of Apache Spark and distributed data processing concepts.
• Experience with AWS cloud services and cloud-native architectures.
• Proven experience with data lakes, lakehouse architectures, and large-scale data platforms.
• Experience working with Parquet, Avro, and related storage technologies.
• Experience leading technical initiatives and mentoring engineering teams.
• Demonstrated experience leveraging AI-assisted development tools within software engineering workflows.

Preferred Qualifications

• Experience with workflow orchestration platforms such as Airflow, Dagster, or Control-M.
• Experience with streaming technologies including Kafka and Spark Structured Streaming.
• Knowledge of Change Data Capture (CDC), upsert strategies, and incremental processing frameworks.
• Experience with Delta Lake, Apache Iceberg, or Apache Hudi.
• Experience working with Snowflake or other cloud data warehouse technologies.
• Familiarity with FinOps and cloud cost optimization practices.
• Experience operating mission-critical systems in regulated environments.
• Understanding of compliance, audit, privacy, and PII governance requirements.
• Experience building or supporting Generative AI and Agentic AI solutions.

Required Technical Skills
Programming Languages

• Java
• Python

Cloud & Platform

• AWS
• Data Lake / Lakehouse Architecture

Big Data Technologies

• Apache Spark
• Parquet
• Avro

Data Engineering

• ETL / ELT Development
• Data Modeling
• Data Quality
• Data Governance
• Data Lineage

Software Engineering

• REST APIs
• CI/CD
• Automated Testing
• Observability
• Secure Coding

AI & Automation

• AI-Assisted Software Development Tools
• AI Code Review and Test Automation
• Responsible AI Practices

Medical, dental, and vision insurance are available to qualified candidates who meet eligibility requirements.
By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.
Contact:
This job and many more are available through The Judge Group. Please apply with us today!