Databricks Platform Engineer Lead

Introduction:

As a Databricks Platform Engineer Lead, you will play a key role in managing and optimizing our Databricks platform. You will be responsible for designing, implementing, and maintaining the infrastructure as code for Databricks on both Azure and AWS cloud environments. Your expertise in Terraform, Azure, AWS, and Databricks will be crucial in ensuring the platform runs smoothly and efficiently.

Responsibilities:

• Lead the design and implementation of infrastructure as code for Databricks platform
• Manage and optimize Databricks platform on Azure and AWS cloud environments
• Collaborate with cross-functional teams to ensure seamless integration of Databricks platform
• Troubleshoot and resolve any issues related to Databricks platform performance
• Implement best practices for security and compliance on Databricks platform
• Provide technical guidance and mentorship to junior team members

Requirements:

Required Skills:

• Proven experience with Infrastructure as Code
• Strong proficiency in Terraform for managing infrastructure
• Hands-on experience with Azure and AWS cloud environments
• In-depth knowledge of Databricks platform

Preferred Skills:

• Experience with GitHub Actions for CI/CD
• Familiarity with GitLab CI/CD pipelines
• Certifications in Azure or AWS cloud services