Data Platform Architect (DataBricks)

About Us:

CodeForce 360 is a trusted global IT talent partner helping Fortune 500 companies, system integrators, and enterprise organizations build high-performing technology teams. With over 16 years of industry expertise, we combine speed, precision, and market intelligence to deliver exceptional talent across today's most in-demand technologies.

About the Job- We are looking for an experienced D365 Sr Finance Consultant to join one of our enterprise client engagements. The ideal candidate should have strong expertise in Spark, Kafka, AWS, Azure, or Google Cloud Platform along with experience working in fast-paced enterprise environments.

MUST HAVE:

• Large-scale data migration and modernization experience - greenfield large data platform implementation preferred
• Expertise in Medallion Architectures
• Big data movement and transport
• Data warehousing fundamentals - schema design (star/snowflake), fact and dimensions, SCDs
• Spark
• Kafka
• AWS, Azure, or Google Cloud Platform
• Java/Python programming background

Key Responsibilities

• Define the target-state architecture for enterprise data platforms and cloud-native analytics solutions.
• Lead the migration of large-scale data environments from on-premises platforms to a cloud environment.
• Design scalable, resilient, and secure data architectures capable of supporting petabyte-scale workloads.
• Establish architectural standards, governance frameworks, and engineering best practices.
• Partner with infrastructure, security, and application teams to ensure alignment with enterprise cloud strategies.
• Evaluate and recommend technologies for data storage, processing, streaming, governance, and observability.
• Provide technical leadership and mentorship to engineering teams implementing Spark, Kafka, Databricks, and cloud-native services.
• Drive performance optimization, cost management, and operational excellence across the data platform.
• Support executive stakeholders with migration roadmaps, risk assessments, and modernization strategies.

Required Qualifications

Experience:

• 10+ years of experience in data platform architecture, data engineering, or distributed systems.
• Demonstrated experience leading enterprise-scale cloud migration initiatives involving hundreds of terabytes or petabytes of data.
• Experience migrating data from platforms such as Vertica, Hadoop, Teradata, Oracle, Snowflake, or similar technologies.
• Experience designing highly available, scalable distributed systems.

Technical Skills:

• Strong experience with Databricks, Apache Spark, Apache Kafka, AWS cloud services, and large-scale data warehouse or lakehouse platforms.
• Experience with AMPS, MQ, Hadoop, or other enterprise messaging systems.
• Strong software engineering background with expertise in Java, Python, SQL, and other object-oriented programming languages.
• Strong understanding of data governance, security, compliance, and operational monitoring.

Preferred Qualifications

• Databricks certification(s)
• AWS Solutions Architect certification(s)
• Experience implementing lakehouse architectures.
• Experience designing streaming and real-time analytics platforms.
• Experience within highly regulated financial services or enterprise environments.
• Master’s Degree