Back to Jobs
Recently postedOther

Databricks Architect

Georgia ITUnited States🇺🇸United States

Why this role stands out

This remote Databricks Architect role offers a fantastic opportunity to leverage your extensive data engineering and consulting expertise on impactful, end-to-end implementations. If you excel at designing and delivering modern data solutions and thrive in client-facing roles, this position is perfect for you to further develop your skills and contribute to innovative projects.

Quick overview

SeniorityMid Senior
Work modeHybrid
LocationUnited States
GitApache SparkAWSETLMLOpsMLflowApacheDatabricksGitHub ActionsGitLab CIGoogle CloudJenkinsUnityAzureMachine LearningData AnalysisCI/CDAzure DevOpsDelta Lake

Job description

Databricks Solution Architect


Location: San Francisco, CA (Remote)
Work Schedule: Must be available to work in Pacific Standard Time (PST)
Employment Type: Contract

Job Overview

We are seeking an experienced Databricks Resident Solution Architect with a strong background in enterprise data architecture, modern data engineering, and cloud-based data platforms. The ideal candidate will combine strategic solution architecture capabilities with extensive hands-on technical expertise.

This role requires a proven technical leader who can architect, design, develop, and implement scalable Databricks solutions while working closely with clients and engineering teams. Candidates should have successfully delivered multiple end-to-end Databricks implementations and possess deep expertise in the Databricks Lakehouse Platform.

Candidates holding the Databricks Solutions Architect Champion certification will receive strong preference.

Key Responsibilities

  • Lead the architecture, design, and implementation of enterprise-scale Databricks solutions.

  • Drive end-to-end Databricks implementations, from architecture planning and technical design through development, deployment, and production support.

  • Provide hands-on technical leadership in developing scalable ETL/ELT pipelines and data engineering solutions.

  • Design and optimize cloud-native data platforms using AWS, Microsoft Azure, and/or Google Cloud Platform (Google Cloud Platform).

  • Develop and implement solutions leveraging Apache Spark, Delta Lake, Structured Streaming, and modern data engineering frameworks.

  • Establish and implement best practices for data architecture, performance optimization, scalability, security, and cost efficiency.

  • Design and implement CI/CD and DevOps processes for production-grade data engineering solutions.

  • Leverage Databricks platform capabilities, including Unity Catalog, Workflows, MLflow, Delta Live Tables, and other Lakehouse technologies.

  • Provide technical guidance, troubleshoot complex data platform challenges, and recommend appropriate architectural solutions.

  • Collaborate with business stakeholders, clients, data engineers, and technical teams to translate business requirements into effective technical solutions.

  • Support MLOps practices, including machine learning lifecycle management, model deployment, and monitoring.

Required Technical Skills & Qualifications

  • 12–15+ years of experience in Data Engineering, Data Platforms, Data Analytics, and Modern Data Warehouse solutions.

  • 10+ years of consulting experience, including client-facing technical delivery and solution architecture.

  • Proven track record of delivering 6–8+ end-to-end Databricks implementations as a hands-on developer, technical lead, or solution architect.

  • Databricks Data Engineering Professional certification or an equivalent advanced Databricks certification.

  • Strong expertise in cloud-native data platform architecture across AWS, Azure, and/or Google Cloud Platform, with deep hands-on proficiency in at least one cloud platform.

  • Advanced knowledge of Apache Spark, including performance tuning, partitioning strategies, execution plans, memory management, and Spark internals.

  • Extensive hands-on experience building scalable ETL/ELT pipelines using Databricks, Delta Lake, and Structured Streaming.

  • Strong understanding of the Databricks Lakehouse Platform, including:

    • Delta Lake

    • Unity Catalog

    • Databricks Workflows

    • MLflow

    • Delta Live Tables (DLT)

  • Experience implementing DevOps and CI/CD pipelines using Azure DevOps, GitHub Actions, GitLab CI/CD, or Jenkins.

  • Working knowledge of MLOps principles, machine learning lifecycle management, model deployment, and monitoring.

  • Strong experience optimizing large-scale distributed workloads for performance, scalability, and cost efficiency.

  • Excellent problem-solving, communication, client engagement, and technical leadership skills.

Will your resume get past this employer's screening? Check your resume against this job, free

Similar jobs