Senior Data Architect – AI & Data Engineering

Job Overview

We are seeking a highly experienced and innovative Solution Architect to evaluate and optimize data engineering processes, identify opportunities for automation, and drive the implementation of AI-powered solutions. The ideal candidate will bring strong hands-on expertise in Agentic AI, AI-driven data engineering, SDLC automation, Databricks, and AWS Redshift.

This role requires a proactive, strategic thinker who can independently identify business challenges, develop proof of concepts (POCs), and transform innovative ideas into scalable, production-ready solutions. The successful candidate will collaborate with cross-functional teams and business stakeholders to deliver impactful data and AI initiatives.

Key Responsibilities

• Assess existing data engineering processes and identify opportunities for optimization, automation, and improved efficiency.

• Design and implement AI-enabled solutions to enhance data engineering workflows and development processes.

• Develop and validate proof of concepts (POCs) for innovative data and AI solutions.

• Leverage Agentic AI and AI technologies to automate and improve activities across the Software Development Life Cycle (SDLC).

• Design, develop, and optimize scalable data architectures using Databricks and AWS Redshift.

• Identify opportunities to integrate AI capabilities into data pipelines, data processing, testing, and deployment workflows.

• Collaborate with business stakeholders, data engineers, architects, and technology teams to define requirements and align solutions with business objectives.

• Drive technical innovation by proactively identifying challenges and recommending effective solutions.

• Translate business requirements into scalable, secure, and high-performance data architecture designs.

• Lead the implementation and adoption of AI-driven automation initiatives.

• Evaluate emerging technologies and recommend solutions that improve operational efficiency and business outcomes.

• Ensure solutions meet enterprise standards for scalability, performance, reliability, and maintainability.

Required Qualifications

• Extensive experience in data architecture, data engineering, and solution design.

• Strong hands-on experience with Databricks and AWS Redshift.

• Proven expertise in Agentic AI, AI-driven automation, and AI applications across the SDLC.

• Experience designing and implementing scalable data engineering solutions.

• Strong understanding of data pipelines, ETL/ELT processes, data integration, and data processing frameworks.

• Experience developing POCs and converting successful prototypes into production-ready solutions.

• Demonstrated ability to identify opportunities for process improvement, automation, and AI enablement.

• Strong problem-solving, analytical, and architectural design skills.

• Excellent communication and stakeholder management skills.

• Ability to work independently, take ownership of initiatives, and deliver results with minimal supervision.

Preferred Qualifications

• Experience integrating AI agents into enterprise data engineering workflows.

• Knowledge of AI-assisted software development, automated testing, and deployment processes.

• Experience with cloud-based data platforms and modern data architecture patterns.

• Familiarity with Python, SQL, APIs, and workflow orchestration.

• Experience driving technology transformation and innovation initiatives.

Ideal Candidate Profile

The ideal candidate is a hands-on technical leader who combines deep data engineering expertise with practical AI implementation experience. They should be self-motivated, innovative, and comfortable leading high-impact initiatives, engaging with business stakeholders, and delivering scalable solutions independently.