Databricks Subject Matter Expert (SME)

About Us:

CodeForce 360 is a trusted global IT talent partner helping Fortune 500 companies, system integrators, and enterprise organizations build high-performing technology teams. With over 16 years of industry expertise, we combine speed, precision, and market intelligence to deliver exceptional talent across today's most in-demand technologies.

 

About the Job- We are looking for an experienced Databricks Subject Matter Expert (SME) to join one of our enterprise client engagements. The ideal candidate should have strong expertise in Data Bricks Admin, Azure, AWS, Google Cloud Platform, Databricks SME along with experience working in fast-paced enterprise environments.

 

Job Description:

• Data BI & Integration Platforms is seeking an experienced Cloud Platform Databricks SME, responsible for overseeing the Platform administration, Security, new NPI tools integration, migrations, platform maintenance and other platform administration activities on Azure/AWS.
• The ideal candidate will have hands-on experience with Azure/AWS services – Infrastructure as Code (IaC), platform provisioning & administration, cloud network design, cloud security principles and automation.

 

Responsibilities:

• Databricks Subject Matter Expert (SME) plays a pivotal role in admin, security best practices, platform sustain support, new tools adoption, cost optimization, supporting new patterns/design solutions using the Databricks platform.

Here’s a breakdown of typical responsibilities:

Core Technical Responsibilities:

• Architect and optimize big data pipelines using Apache Spark, Delta Lake, and Databricks-native tools.
• Design scalable data ingestion and transformation workflows, including batch and streaming (e.g., Kafka, Spark Structured Streaming).
• Create integration guidelines to configure and integrate Databricks with other existing security tools relevant to data access control.
• Implement data security and governance using Unity Catalog, access controls, and data classification techniques.
• Support migration of legacy systems to Databricks on cloud platforms like Azure, AWS, or Google Cloud Platform.
• Manage cloud platform operations with a focus on FinOps support, optimizing resource utilization, cost visibility, and governance across multi-cloud environments.

 

Collaboration & Advisory:

• Act as a technical advisor to data engineering and analytics teams, guiding best practices and performance tuning.
• Partner with architects and business stakeholders to align Databricks solutions with enterprise goals.
• Lead proof-of-concept (PoC) initiatives to demonstrate Databricks capabilities for specific use cases.

 

Strategic & Leadership Contributions:

• Mentor junior engineers and promote knowledge sharing across teams.
• Contribute to platform adoption strategies, including training, documentation, and internal evangelism.
• Stay current with Databricks innovations and recommend enhancements to existing architectures.
• Specialized Expertise (Optional but Valuable)

 

Machine Learning & AI integration:

• Using MLflow, AutoML, or custom models.
• Cost optimization and workload sizing for large-scale data processing.
• Compliance and audit readiness for regulated industries.

 

Must Have Skills:

• Data Bricks Admin
• Data Bricks
• Support experience

 

Qualifications:

• At least 12 years of experience in IT cloud infrastructure, architecture and operations, including security, with at least 5 years in a Platform admin role
• Strong understanding of data security principles and best practices.
• Expertise in Databricks platform, security features, Unity Catalog, and data access control mechanisms.
• Experience with data classification and masking techniques.
• Strong understanding of cloud cost management, with hands-on experience in usage analytics, budgeting, and cost optimization strategies across multi-cloud platforms.
• Strong knowledge of cloud architecture, design, and deployment principles and practices, including microservices, serverless, containers, and DevOps.
• Deep expertise in Azure/AWS big data & analytics technologies, including Databricks, real time data ingestion, data warehouses, serverless ETL, No SQL databases, DevOps, Kubernetes, virtual machines, web/function apps, monitoring and security tools.
• Deep expertise in Azure/AWS networking and security fundamentals, including network endpoints & network security groups, firewalls, external/internal DNS, load balancers, virtual networks and subnets.
• Proficient in scripting and automation tools, such as PowerShell, Python, Terraform, and Ansible.
• Excellent problem-solving, analytical, and communication skills, with the ability to explain complex technical concepts to non-technical audiences.
• Certifications in Azure/AWS/Databricks platform administration, networking and security are preferred.
• Strong self-organization, time management and prioritization skills
• A high level of attention to detail, excellent follow through, and reliability
• Strong collaboration, teamwork and relationship building skills across multiple levels and functions in the organization
• Ability to listen, establish rapport, and credibility as a strategic partner vertically within the business unit or function, as well as with leadership and functional teams
• Strategic thinker focused on business value results that utilize technical solutions
• Strong communication skills in writing, speaking, and presenting
• Capable to work effectively in a multi-tasking environment.

 

Minimum years of experience: 8-10 years

 

Top 3 responsibilities you would expect the Subcon to shoulder and execute:

• Admin activities for Data Bricks
• Manage security Policies
• Manage incident resolution

 

How To Apply

Job ID: JPC – 235872

 

Contact:

Name: Sreekar Konapuram

Email:

Phone:

  

CodeForce 360 proudly provides equal employment opportunities to all employees and applicants and prohibits discrimination and harassment of any kind without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by applicable federal, state, or local laws.