Back to Jobs
Recently postedEngineering

Lead Project Engineer

Lorven Technologies, Inc.San Francisco, CA🇺🇸United States

Quick overview

SeniorityMid Senior
Work modeHybrid
LocationSan Francisco, CA, United States
Stakeholder ManagementAgile

Job description

Hi,
Our client is looking
Lead Data Engineer Databricks Data Ingestion--for San Francisco, CA project and below is the detailed requirement.

Job Title : Lead Data Engineer Databricks Data Ingestion
Location : San Francisco, CA

Job Description:              

  • Bachelor's degree in Information Systems, Business Administration, Computer Science, or related field.
  • 8+ years of experience in data engineering, data integration, and enterprise data platforms.
  • Strong hands-on experience with Databricks Lakeflow Connect and Databricks-native data ingestion capabilities.
  • Experience with Databricks Native Data Loader or related native ingestion tooling.
  • Strong knowledge of Apache Spark, PySpark, and Delta Lake.
  • Hands-on experience ingesting and migrating data from Oracle, MySQL, and Microsoft SQL Server.
  • Strong experience designing and implementing ETL/ELT pipelines and large-scale data integration solutions.
  • Understanding of incremental ingestion, CDC, schema evolution, and data reconciliation.
  • Experience with batch and streaming data processing.
  • Strong SQL skills and knowledge of relational database concepts.
  • Experience with data quality, pipeline monitoring, troubleshooting, and performance tuning.
  • Proven technical leadership, mentoring, and stakeholder collaboration skills.
  • Experience with Agile methodologies, CI/CD, automated testing, and technical documentation.
  • Strong documentation, communication, and stakeholder management skills.

Similar jobs