Haystack
← Back to Jobs
Remote
Technology
IN

Databricks Solutions Architect (Need Visa Independent Candidates only)

Incorporan IncUnited States🇺🇸United StatesPosted 10 Sept 2026

Quick Overview

Seniority
Mid Senior
Work mode
Remote
Location
United States
Posted
23 hours ago
SQLAWSETLAzureDatabricksGitHub ActionsGitLab CIGoogle CloudJenkinsKafkaTerraformUnity

Job Description

INCORPORAN INC is looking for Databricks Solutions Architect for our client in the location is Remote

Title: Databricks Solutions Architect

Location: Remote

Duration: Long term Project

Job Description:

 

Experience: 15+ Years overall (5+ Years hands-on Databricks Platform experience required) 
Databricks Certification: Mandatory
 
Job Summary:
We are seeking a hands-on, customer-facing Resident Solutions Architect with deep Databricks Platform expertise, combined with strong CI/CD and Terraform skills. This is an architect-level role for someone who can work directly with enterprise clients, design scalable Lakehouse and data platform solutions, and stay hands-on through build, deployment, and production support — including infrastructure-as-code delivery of the Databricks platform itself.
 
Required Skills
  • 15+ years of experience in Data Engineering, Cloud Engineering, Solutions Architecture, or Platform Engineering.
  • Databricks Certification required (e.g., Databricks Certified Data Engineer Professional, Databricks Certified Solutions Architect, or equivalent).
  • 5+ years of hands-on Databricks Platform experience, including:
  • PySpark, Spark SQL, and Delta Lake
  • Lakehouse Architecture design and implementation
  • Unity Catalog governance and security
  • Delta Live Tables (DLT)
  • Databricks Workflows
  • Workspace and Account Administration
  • SQL Warehouses
  • Strong hands-on Terraform experience with Databricks, including reusable modules for workspace, cluster, and Unity Catalog provisioning.
  • Strong CI/CD experience (GitHub Actions, GitLab CI/CD, Jenkins, Azure DevOps, or equivalent), including CI/CD for Databricks Asset Bundles, notebooks, and jobs.
  • Strong Spark performance tuning expertise — partitioning, caching, AQE, and data skew resolution.
  • Kafka and Structured Streaming experience.
  • Strong experience with AWS, Azure, or Google Cloud Platform.
  • Proven customer-facing experience providing architectural guidance and Databricks best practices to enterprise clients.
  • Strong communication and stakeholder-management skills, with the ability to translate business needs into practical Lakehouse solutions.
Key Responsibilities
  • Serve as a resident, customer-facing Databricks Solutions Architect, providing architectural guidance, best practices, and hands-on delivery for enterprise Lakehouse implementations.
  • Design and implement scalable Lakehouse architectures using PySpark, Spark SQL, and Delta Lake.
  • Own Unity Catalog governance and security design, including data access controls, lineage, and cross-workspace governance patterns.
  • Build and operate production data pipelines using Delta Live Tables (DLT) and Databricks Workflows.
  • Administer Databricks Workspaces and Accounts, including provisioning, access management, and platform configuration.
  • Provision and manage Databricks infrastructure using Terraform, including workspace, cluster, Unity Catalog, and job/workflow resources as reusable, version-controlled modules.
  • Design and implement CI/CD pipelines for Databricks assets (notebooks, DLT pipelines, jobs, ML models) using GitHub Actions, GitLab CI, Jenkins, Azure DevOps, or equivalent, including Databricks Asset Bundles.
  • Perform Spark performance tuning — partitioning, caching, Adaptive Query Execution (AQE), and data skew mitigation — to optimize cost and performance at scale.
  • Design and manage SQL Warehouses for BI and analytics workloads.
  • Build streaming data solutions using Kafka and Structured Streaming.
  • Architect Databricks solutions across AWS, Azure, or Google Cloud Platform, tailored to each cloud's native services and security model.
  • Partner directly with client engineers, business stakeholders, and executives to translate business problems into Databricks/Lakehouse solutions and measurable outcomes.
  • Guide client teams through migration from legacy ETL platforms (e.g., Informatica) to Databricks.

Please send me your resumes and contact details at  or call Rajesh at 

Similar jobs

Browse related jobs

Apply now