Databricks Subject Matter Expert

Hi,

Please find the job description below

Role: Databricks Subject Matter Expert
Location: Dallas, TX

Position Description

Solution Architecture & Design
•    Lead end to end design of Databricks Lakehouse architectures, including Delta Lake, Unity Catalog, and medallion (bronze/silver/gold) data models.
•    Define reference architectures, best practices, and reusable accelerators for client engagements.
•    Evaluate and recommend deployment patterns across Azure Databricks, AWS Databricks, and Google Cloud Platform, aligning platform choices with client infrastructure and governance needs.

Data Engineering & Pipeline Development
•    Architect and oversee large scale ETL/ELT pipelines using Apache Spark, Delta Live Tables, and Databricks Workflows.
•    Design real time and batch ingestion frameworks covering structured, semi structured, and unstructured data sources.
•    Establish data quality, lineage, and observability standards using Unity Catalog, Delta Lake features, and complementary tooling.

Machine Learning & MLOps
•    Guide clients on implementing end to end ML workflows using MLflow, Feature Store, and Model Serving on Databricks.
•    Advise on MLOps patterns including model versioning, A/B testing, monitoring, and automated retraining pipelines.
•    Collaborate with data science teams to productionize models and integrate ML outputs into business applications.

Client Advisory & Engagement Leadership
•    Serve as the trusted advisor to senior client stakeholders on all matters related to data platform strategy and Databricks adoption.
•    Lead discovery workshops, architecture reviews, and technical assessments to define solution roadmaps.
•    Support pre sales efforts by developing proposals, estimating level of effort, and delivering technical demonstrations.

Thought Leadership & Practice Development
•    Contribute to the firm's intellectual property by developing frameworks, white papers, and training curricula around Databricks.
•    Mentor and upskill consultants across the data practice; foster a community of Databricks practitioners.
•    Represent the firm at industry events, Databricks partner summits, and webinars.

Required Qualifications
•    10+ years of professional experience in data engineering, analytics, or platform architecture.
•    5+ years of deep, hands on experience with Databricks, including production deployments at enterprise scale.
•    Expert level proficiency in Apache Spark (PySpark and/or Scala), Delta Lake, and SQL.
•    Proven track record designing multi cloud Lakehouse architectures (Azure, AWS, or Google Cloud Platform).
•    Strong experience with Unity Catalog for data governance, access control, and lineage tracking.
•    Demonstrated ability to lead client facing engagements and communicate complex technical concepts to executive audiences.
•    Experience in a consulting or professional services environment, with a history of managing multiple concurrent engagements.
•    Bachelor's degree in Computer Science, Engineering, Data Science, or a related field (or equivalent practical experience).

Preferred Qualifications
•    Databricks Certified Data Engineer Professional or Machine Learning Professional certification.
•    Experience with Delta Live Tables, Databricks Workflows, and Photon engine optimization.
•    Familiarity with complementary tools such as dbt, Terraform/Pulumi (IaC), and CI/CD pipelines for data platforms.
•    Hands on experience with MLflow, Feature Store, and Model Serving in production environments.
•    Prior experience as a Databricks partner or in a Databricks aligned practice within a consulting firm.
•    Advanced degree (M.S. or Ph.D.) in a quantitative or technical discipline.