Quick Overview
Job Description
We are seeking a highly skilled Lead Data Engineer / Senior Data Engineer with strong hands-on experience in Data Engineering, Azure Databricks, and AI-enabled analytics to design, develop, and support enterprise-scale Marketing Intelligence and Conversational BI solutions. The ideal candidate will be responsible for building scalable data platforms, developing data products, and enabling AI-driven analytics capabilities using modern Databricks technologies.
Experience with Databricks Genie, Semantic Modeling, Salesforce, Marketo, and digital marketing platforms is highly desirable.
Responsibilities
- Design, develop, and maintain scalable data pipelines and data products using Azure Databricks and modern Data & AI engineering practices.
- Implement and optimize data ingestion, transformation, and orchestration frameworks using PySpark, SQL, Python, and Azure Data Factory.
- Build and manage curated data layers following Medallion Architecture (Bronze, Silver, Gold).
- Develop semantic models, business-ready datasets, and governed data products to support analytics and AI use cases.
- Implement and support Databricks Genie for conversational analytics and self-service business intelligence.
- Collaborate with architects, business analysts, and stakeholders to translate business requirements into scalable technical solutions.
- Integrate and model data from marketing platforms including Salesforce, Marketo, Google Ads, LinkedIn Ads, and Bing Ads.
- Ensure data quality, performance optimization, governance, and security using Unity Catalog and industry best practices.
- Support AI-powered analytics, GenAI, and conversational BI initiatives by enabling AI-ready data foundations.
- Mentor junior engineers, conduct code reviews, and promote engineering best practices across the team.
- Participate in Agile ceremonies, sprint planning, backlog refinement, and release activities.
Experience
- 7+ years of experience in Data Engineering and cloud-based analytics solutions.
- 3+ years of hands-on experience with Azure Databricks and modern data platforms.
- Experience delivering enterprise-scale data, analytics, or AI solutions.
- Experience in Marketing Analytics, Customer Analytics, or Digital Marketing domain is highly preferred.
Similar jobs
- FT
MS Fabric Data Engineer
NewFlexon Technologies Inc.
Tampa, FL🇺🇸Hybrid21 hours agoSQLETLData PipelineTechnology - CS
Data Engineer - Remote - EST - W2 / Own corporation - 35/hr on w2 - NO agency candidates
NewCyber Sphere LLC
United States🇺🇸Remote21 hours agoSQLPower BIdbtTechnology - AS
Data engineer with Atacamma
NewAlgo Soft Solutions LLC
United States🇺🇸Hybrid21 hours agoScrumAgileTechnology - AK
lead data engineer with snowflake cortrex + Aws Bed rock
NewAkshaya Inc
United States🇺🇸Hybrid21 hours agoShellAWSEncryption+4Technology - FY
Lead Data Engineer
NewFynbosys Inc
Cary, NC🇺🇸On-site21 hours agoNeo4jSQLScala+13Technology - PT
Senior Data Scientist / Data Engineer Generative AI Engine Optimization
NewProjas Technologies, LLC
United States🇺🇸Hybrid21 hours agoSQLAWSETL+13Technology - KT
Senior AI/ML Data Engineer
NewKforce Technology Staffing
Frisco, TX🇺🇸Hybrid21 hours agoNeo4jSQLAWS+9Technology - ST
Data Engineer with MS Fabric
NewSaim Technologies
United States🇺🇸Hybrid21 hours agoSQLData PipelineTechnology - KT
Remote Senior Data Engineer
NewKforce Technology Staffing
Atlanta, GA🇺🇸Remote21 hours agoSQLAWSETL+8Technology - TE
Lead AWS Data Engineer
NewTekcel8
United States🇺🇸Remote21 hours agoAWSETLApache+2Technology - CS
Journeyman Data Manager in Arlington, Virginia with Security Clearance
CIS Secure
Arlington, VA🇺🇸On-site2 weeks agoSQLMicrosoft OfficePower BI+1Technology - CS
Lead Data Engineer
NewCynet Systems
Fremont, CA🇺🇸Hybrid21 hours agoSQLETLSOC 2+2Technology