Senior Databricks Platform Architect

Title: Senior Databricks Platform Architect

Location: Jersey City, NJ, Onsite (5-Days)

6+ months Contract 

Role Description

Seeking a Senior Databricks Platform Architect to lead secure, scalable Databricks deployments on AWS. This role requires hands-on infrastructure expertise combined with the ability to independently lead architecture and enablement sessions with large customer teams.

 

Key Responsibilities

• Design and deploy Databricks classic and serverless workspaces on AWS, including networking, storage, and identity integration
• Author and maintain Terraform modules to provision and manage AWS and Databricks resources in a repeatable, secure manner
• Define and implement platform security architecture, including workspace isolation, cluster access controls, secrets management, and network security patterns
• Lead architecture enablement sessions and workshops with large, cross-functional customer teams
• Guide customer teams through Databricks security accreditation and compliance processes
• Partner with customer cloud, security, network, and platform teams to validate architecture decisions and troubleshoot deployment issues
• Produce clear architecture documentation, diagrams, and runbooks for platform configurations

Required Qualifications

• 10+ years of experience in cloud infrastructure, data platform engineering, or platform architecture.
• 3–5+ years of hands-on experience designing, deploying, configuring, and securing Databricks on AWS, including classic and serverless workspaces. Strong experience with Databricks platform administration, workspace architecture, security configuration, and production deployments is required.
• Strong hands-on experience with Terraform and Infrastructure as Code (IaC) for provisioning and managing Databricks and AWS resources. Experience with CI/CD pipelines, infrastructure automation, deployment administration, and DevOps best practices is highly preferred.
• Proven experience designing and implementing Databricks platform security, including workspace isolation, identity/SSO integration, cluster access controls, secret scopes, and secure platform configuration.
• Demonstrated ability to independently lead architecture workshops, technical enablement sessions, and design reviews with customers and cross-functional stakeholders.
• Experience producing architecture documentation, platform diagrams, implementation guides, and operational runbooks.
• Working knowledge of AWS infrastructure and networking, including S3, IAM, VPCs, PrivateLink, load balancing, and networking concepts. Hands-on experience is preferred, but deep networking expertise is not required.
• Excellent verbal and written communication skills with the ability to partner effectively with cloud, networking, security, and platform engineering teams.