Databricks Architect

Hi Professional,

Our client is looking for Databricks Architect  project in Princeton,NJ below is the detailed requirements.

Job Title : Databricks Architect
Location : Princeton,NJ

Description:

• Bachelor's degree or Master’s Degree in Computer science, or a related field, with minimum 12+ years of experience.
• You should Contribute to the design and implementation of scalable data architectures, such as a Lakehouse, using Delta Lake and Unity Catalog.
• Must Manage and maintain the underlying data infrastructure, which typically exists on a major cloud platform like AWS, Azure, or Google Cloud Platform.
• You should Implement data governance practices, including data lineage, metadata management, and access controls integrating with other 3rd party products like Immuta, Protegrity for tokenization etc.
• Good Experience to Adhere to software engineering best practices, including participating in code reviews and CI/CD (Continuous Integration/Continuous Deployment) automation.
• Must Stay up to date with the latest trends and technologies in data engineering and the Databricks ecosystem.
• You should Design and build robust ETL (Extract, Transform, Load) and ELT workflows to ingest, transform, and load structured and unstructured data from various sources.
• Must Utilize Databricks features like Delta Live Tables and Databricks Workflows to orchestrate and manage complex data processes.
• You should Optimize and tune Apache Spark jobs for performance and cost efficiency on large datasets.
• Implement and enforce data security, access control, and compliance policies in Databricks and Azure.
• Must have a Hands on experience working on streaming technologies (Kafka, Event Hubs, Kinesis).
• Good Experience architecting machine learning platforms, advanced analytics workloads and develop and deployment of MLOPS on Databricks.
• Must be Expertise with enterprise security models, networking, and cost governance.
• You Should have experience working with DevOps teams to establish deployment practices using Terraform or similar.
• Must Optimize Databricks performance (auto-scaling, caching, delta optimization, job tuning, cost optimization).
• Good Prior experience in leading enterprise Azure Databricks implementations