Senior Data Tech Lead / Architect – AWS Streaming Data Platform

Role: Senior Data Tech Lead / Architect – AWS Streaming Data Platform

Location: Florham Park, NJ / Austin, TX (Local Preferred) – Hybrid

Interview: Virtual
Experience: 15-20 Years
Domain: Wealth Management / Financial Services

About the Role

We are seeking a hands-on Senior Data Tech Lead / Architect to lead the architecture, design, and implementation of enterprise-scale AWS streaming data platforms. The ideal candidate will have deep expertise in Kafka/MSK, AWS Glue, PySpark, Flink, CDC frameworks, and Event-Driven Architectures, along with prior experience in Wealth Management or Financial Services environments.

⭐ Key Responsibilities

Lead architecture and solution design for real-time and batch data platforms

Design and implement CDC-based ingestion using AWS DMS, Kafka/MSK, Kafka Connect, and Debezium

Build scalable streaming and batch pipelines using AWS Glue (PySpark) and Flink

Define data quality, reconciliation, lineage, observability, and SLA frameworks

Design Iceberg-based Data Lakehouse architectures on AWS

Drive API and event-driven integration patterns across enterprise applications

Provide architectural governance, technical leadership, and mentorship to engineering teams

Collaborate with Product Owners, Architects, and Business stakeholders to define technical roadmaps

⭐ Required Skills (Must-Have)

15+ years overall IT experience, with 5+ years as a Data Architect, Principal Engineer, or Technical Lead

6+ years hands-on AWS Data Engineering experience

Strong expertise in Apache Kafka / AWS MSK — topic design, partitioning, scalability, performance tuning

Hands-on experience with AWS Glue (PySpark), Flink, and Streaming ETL

Strong experience with AWS DMS, CDC patterns, Kafka Connect, and Debezium

Expertise in Event-Driven Architecture and Microservices-based integrations

Experience with Apache Iceberg, S3, DynamoDB, Lake Formation, and Data Lakehouse concepts

Strong knowledge of Data Quality, Data Reconciliation, Data Governance, and Data Observability frameworks

Experience with Terraform/CDK, CI/CD, Git, and cloud-native DevOps practices

Experience designing and supporting large-scale, business-critical data platforms

Preferred Skills

Wealth Management, Asset Management, Investment Management, Capital Markets, or Financial Services experience

Exposure to PostgreSQL, Athena, Lambda, Step Functions, CloudWatch, SNS, and EventBridge

Experience building platforms processing high-volume, real-time event streams

Ideal Candidate Profile

Architect-level ownership of enterprise data platforms

Strong stakeholder management and executive communication skills

Hands-on technical leader — not a people-manager-only profile

Proven track record driving architecture decisions, best practices, and technology roadmaps