Haystack
← Back to Jobs
Technology
IT

Databricks Solution Architect

Ideate Technologies LLCMalvern, PA🇺🇸United StatesPosted Sep 24, 2026

Quick Overview

Seniority
Mid Senior
Work mode
On Site
Location
Malvern, PA, United States
Posted
Yesterday
SQLScalaAWSMLflowSnowflakeAzureDatabricksGitHub ActionsHadoopJenkinsKafkaRESTRedshiftTerraformUnityVault

Job Description

Required Experience: 15+ years in enterprise data platforms, cloud modernization, and complex system integrations.

Must-Have Skills:
Databricks: Lakehouse, Delta Lake, Unity Catalog, DLT, Databricks SQL, MLflow
Big Data: Spark, PySpark, Scala, Kafka, Streaming Architectures
Cloud: Azure Databricks, ADF, ADLS, Synapse, AWS S3, Glue, EMR, Redshift
Data Warehousing: Snowflake, Data Vault, Star/Snowflake Schema, CDC
Integration: REST APIs, Event-Driven Architecture, Enterprise SaaS/ERP/CRM Integrations
DevOps: Terraform, Azure DevOps, GitHub Actions, Jenkins, CI/CD
Governance: Data Quality, Metadata Management, Security & Compliance
Key Responsibilities:
Architect and implement enterprise data platforms using Databricks Lakehouse, Delta Lake, Unity Catalog, and Spark.
Design scalable batch, streaming, CDC, and real-time data integration solutions.
Lead migration of legacy data warehouses, Hadoop ecosystems, and on-prem platforms to modern cloud architectures.
Define data governance, security, lineage, metadata management, and compliance frameworks.
Provide technical leadership, architecture governance, solution reviews, and mentoring.
Partner with business and engineering stakeholders to build analytics, AI/ML, and GenAI-ready data ecosystems.
Preferred:
Databricks Certification
Azure Certification
AWS Certification
TOGAF Certification
Experience in BFSI, Capital Markets, Asset Management, or large enterprise environments
Generic Managerial Skills:
Ability to collaborate effectively in an onsite-offshore model.
Ability to influence, guide, and mentor junior team members.
Qualification:
Bachelor’s Degree in Computer Science

Similar jobs