Databricks Architect

Introduction:

We are seeking an experienced Databricks Architect to design and deliver scalable, secure data and AI platforms on the Databricks Lakehouse. This role is pivotal in defining target architecture, establishing engineering standards, and guiding the implementation of data ingestion, transformation, governance, performance optimization, and production operations.

Responsibilities:

• Define and design robust technical solutions that meet business needs.
• Establish engineering standards and best practices for data architecture.
• Guide the implementation of data ingestion, transformation, and governance processes.
• Conduct architecture reviews and technology evaluations to ensure alignment with business objectives.
• Develop reusable frameworks and optimize costs associated with data solutions.
• Implement CI/CD processes for efficient deployment and monitoring of data solutions.
• Provide technical mentoring to team members and stakeholders.
• Collaborate with client stakeholders, data engineers, analysts, security teams, and vendors.

Requirements:

Mandatory Skills:

• 12-15 years of experience in data architecture and engineering.
• Strong expertise in Databricks and cloud architecture.
• Proficient in Spark, Delta Lake, Unity Catalog, SQL, and Python.
• Excellent communication and stakeholder management skills.
• Experience in defining and implementing data governance frameworks.

Preferred Skills:

• Exposure to Generative AI (GenAI) solution patterns.
• Familiarity with enterprise architecture principles.
• Experience with performance optimization techniques in data platforms.
• Knowledge of CI/CD tools and practices.
  

  Thanks & Regards,

  Pradeep Kumar

  International Solutions Group, Inc.

  E-mail:

  Direct: