Haystack
← Back to Jobs
Technology

Data Engineer (GenAI)

SM Global IT LLCSan Jose, CA🇺🇸United StatesPosted 24 Jul 2026

Quick Overview

Work Type
Hybrid
Level
Mid Senior

Job Description

Job Overview:

  • We are seeking a Senior Data Engineer with expertise in Google Cloud Platform, BigQuery, Python, and GenAI to design and build scalable data pipelines and AI-powered solutions.
  • This is a client-facing role requiring strong technical skills, business communication, and the ability to deliver data and LLM-based solutions in a fast-paced environment.

Responsibilities:

  • Design, build, and optimize scalable data pipelines and ETL/ELT workflows.
  • Develop and maintain solutions using BigQuery, Python, and Google Cloud Platform services.
  • Build and integrate LLM-powered applications, including prompt engineering, RAG pipelines, and tool/function calling.
  • Collaborate with business stakeholders to translate requirements into technical solutions.
  • Optimize data models, SQL queries, and pipeline performance.
  • Troubleshoot production issues and support enterprise-scale data platforms.

Required Skills:

  • 8+ years of experience in Data Engineering or Software Engineering.
  • Strong SQL expertise with BigQuery or a comparable cloud data warehouse.
  • Proficiency in Python and/or Java.
  • Hands-on experience with Google Cloud Platform (Google Cloud Platform), including BigQuery, Cloud Composer (Airflow), Dataflow, Pub/Sub, or similar services.
  • Experience building applications using Large Language Models (LLMs), including prompt engineering, RAG, or function/tool calling.
  • Strong understanding of ETL/ELT, data modeling, and performance optimization.
  • Excellent communication skills with the ability to work directly with cross-functional business teams.

Preferred Skills:

  • Experience with OpenAI, Claude, or other production LLM APIs.
  • Familiarity with Model Context Protocol (MCP).
  • Experience with vector databases and embedding-based search.
  • Knowledge of financial reconciliation or transaction-processing systems.
  • Experience with AI usage analytics, cost optimization, and performance monitoring.

Skills

SQL
ETL
Airflow
BigQuery
Google Cloud
Java
LLM
Python

Similar jobs