Senior Data Architect

Introduction:

We are looking for a seasoned Senior Data Architect with over 10 years of experience to join our team on a contract basis in the USA. The ideal candidate will have a strong background in ETL/ELT, AI/ML, and Generative AI, with a focus on RAG infrastructure.

Responsibilities:

• Develop and implement ETL/ELT processes using Python, SQL, and other relevant technologies
• Design and maintain Enterprise Data Warehousing solutions
• Utilize AI/GenAI data engineering tools such as RAG, vector databases, LangChain/LangGraph, and AI Agents
• Work on platforms like Azure OpenAI and AWS Bedrock to support modern AI/ML and Generative AI applications
• Utilize Treasure Data / Treasure Data CDP for real production experience
• Create and manage real-time analytics and event-driven architecture
• Build and maintain streaming data pipelines using technologies like Apache Kafka
• Work with cloud data platforms like Snowflake, Databricks, and AWS/Azure/Google Cloud Platform services
• Implement CDC/Debezium and incremental data processing
• Design batch and real-time enterprise data architectures
• Develop AI-ready data pipelines, semantic search, and RAG infrastructure

Requirements:

Required Skills:

• Strong experience in ETL/ELT, Python, SQL, and Enterprise Data Warehousing
• Knowledge of AI/GenAI data engineering tools
• Experience with real-time analytics and streaming data pipelines
• Hands-on experience with Apache Kafka
• Familiarity with cloud data platforms such as Snowflake, Databricks, and AWS/Azure/Google Cloud Platform
• Experience with CDC/Debezium and incremental data processing
• Ability to design batch and real-time enterprise data architectures

Preferred Skills:

• Experience with Treasure Data, RAG infrastructure, and AI Agents
• Knowledge of AI/ML and Generative AI applications
• Previous experience with Treasure Data CDP
• Experience building AI-ready data pipelines and semantic search