Quick overview
Job description
We are seeking a skilled and driven Data Engineer with 3-5 years of hands-on expertise in data engineering and cloud data warehousing. In this role, you will build, optimize, and maintain our enterprise Databricks Lakehouse platform, which serves as the foundational engine for our data and AI initiatives. You will translate technical requirements into robust data pipelines, implement modern engineering standards, and support data governance, CI/CD, and cost-optimization frameworks.
Key Responsibilities
Pipeline Development & Optimization
- Build and maintain robust, enterprise-grade data pipelines on the Databricks Lakehouse platform to meet business intelligence and AI/ML demands.
- Develop reusable frameworks and apply performance optimization techniques to improve cloud compute efficiency and reduce runtime costs.
- Write and refine clean, efficient code for complex data processing using Python, SQL, Scala, or PySpark.
Data Engineering & Governance
- Execute engineering best practices across the entire data lifecycle, spanning ingestion, transformation, and workflow orchestration.
- Implement end-to-end data pipelines utilizing modern patterns such as Delta Live Tables (DLT) and Apache Spark.
- Apply data governance frameworks, access controls, and data protection strategies locally using Unity Catalog.
Operations & Collaboration
- Support automated CI/CD practices and robust monitoring infrastructure for seamless, reliable deployment of data solutions.
- Collaborate closely with senior architects, analysts, and developers in an environment focused on engineering excellence.
- Work alongside cross-functional engineering units, InfoSec teams, and product owners to deliver high-quality data products.
Role Requirements
- Education: Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or a related technical field.
- Experience: 3–5 years of dedicated experience in data engineering, with a strong focus on building cloud-based data solutions.
- Technical Skills:
- Proficiency with the Databricks ecosystem (Delta Lake, Unity Catalog, Delta Live Tables).
- Strong hands-on experience with Apache Spark (PySpark/Scala) and advanced SQL.
- Experience with cloud platforms (AWS, Azure, or Google Cloud Platform) and orchestration tools (Airflow, ADF, or Databricks Workflows).
- Familiarity with Version Control (Git) and CI/CD tools (GitHub Actions, Azure DevOps, or Jenkins).
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- CA
Data Designer
Carrier · Atlanta, GA · Hybrid 🇺🇸
RecruitingFigmaTableau+7$79k - $158k/yr - AI

Senior Data Software EngineerRecently posted Auto Apply
Airbnb · United States · Hybrid · Posted 20 Nov 2026 🇺🇸
SQLScalaETL+3Technology$196k - $227k/yr - SG

Lead Data EngineerRecently posted
Software Guidance & Assistance · Rockville, MD · Hybrid · Posted 21 Nov 2026 🇺🇸
Stakeholder ManagementSQLApache Spark+7TechnologySalary not listed - CL

Lead Data EngineerRecently posted
ClifyX · Atlanta, GA · On-site · Posted 20 Nov 2026 🇺🇸
SQLGitApache Spark+9TechnologySalary not listed - TM

Data Engineer--cloud security or cloud infrastructureRecently posted
Tech Mahindra (Americas) Inc. · Milpitas, CA · On-site · Posted 20 Nov 2026 🇺🇸
AWSEncryptionCDK+5TechnologySalary not listed - AT

Data Engineer
Aivanta Tech Inc · Texas City, TX · Hybrid 🇺🇸
SQLApache SparkAWS+8TechnologySalary not listed - KE

Senior Data EngineerRecently posted
Kentro · United States · On-site · Posted 20 Nov 2026 🇺🇸
DockerSQLT-SQL+12Technology$158k - $175k/yr - ST

AWS Data Engineer - W2 ContractRecently posted
SDVS Technologies LLC · United States · Hybrid · Posted 20 Nov 2026 🇺🇸
AWSLLMGenerative AI+1TechnologySalary not listed - SE
SQL Server DBARecently posted
SeersolutionsInc · Washington, DC · Hybrid · Posted 20 Nov 2026 🇺🇸
DockerMySQLSQL+11TechnologySalary not listed - GE

Data Engineer - RemoteRecently posted
Genesis10 · Charlotte, NC · Remote · Posted 20 Nov 2026 🇺🇸
SQLAWSETL+3Technology$63/hr - PG

Senior Data EngineerRecently posted
PTR Global · Richmond, VA · Hybrid · Posted 20 Nov 2026 🇺🇸
SQLScalaGit+10Technology$70 - $80/hr - DT
Data Engineer (Azure) - Lansing, MIRecently posted
Digital Technology Solutions · Lansing, MI · Hybrid · Posted 20 Nov 2026 🇺🇸
Stakeholder ManagementSQLT-SQL+7TechnologySalary not listed
