Haystack
← Back to Jobs
Remote
Technology
IT

Data Engineer with Conversational AI

ITBMS Inc.New York, NY🇺🇸United StatesPosted Sep 24, 2026

Quick Overview

Seniority
Mid Senior
Work mode
Remote
Location
New York, NY, United States
Posted
22 hours ago
AWSNLPBigQueryGoogle Cloud

Job Description

Job Title: Data Engineer with Conversational AI

Location: Remote(USA)

Experience: 15+ Years (Must)

Job Description:

Create high-quality, customer-specific synthetic data and own RAG / knowledge pipelines so each deployment ofCCAI, voice, and chat can be configured, grounded, demonstrated, and validated without using real customer PII.You design generation and ingestion pipelines and load data into the correct Google Cloud Platform and AWS services.What success looks likeEach customer engagement has a documented synthetic dataset covering the channels in scope Each in-scope customer has a working RAG / knowledge pipeline: corpus prepared, indexed, retrievable,and evaluated.Data and retrieval quality are good enough for configuration, evaluation, and stakeholder demos, andsafe enough for isolation and compliance expectations.Generation and indexing are parameterized and repeatable, not a one-off manual copy-paste percustomer.Key responsibilitiesAnalyze each customer s domain: intents, entities, knowledge topics, document types, languages, tone,and edge cases.Generate synthetic conversation transcripts for voice and chat, plus CCAI training/evaluation dialogues.Generate supporting content: customer/agent profiles, knowledge-base articles, FAQs, and structuredentity values.Schedule and document index refresh processes when customer knowledge changes.Use appropriate techniques whiledocumenting parameters and limitations.Validate realism, coverage, diversity, and absence of residual real-world PII in synthetic data and sourcecorpora.Maintain reusable generators, ingestion jobs, and quality checklists that can be parameterized percustomer.Partner with the Conversational Platform Specialist so loaded data and indexes actually drive thedeployed experience.Partner with DevOps so pipeline jobs, stores, and secrets are automated and isolated per customer.Required qualifications4+ years in data engineering, conversation design operations, applied NLP data work, or knowledge-pipeline engineering.Working knowledge of how conversational platforms consume training, FAQ, transcript, and retrieval-grounded knowledge data.Strong judgment on synthetic-data quality, retrieval quality, and privacy safety.Preferred qualificationsLLM-assisted synthetic data generation in a production or implementation setting.Familiarity with BigQuery, S3, and document stores used as knowledge sources.Multilingual data generation or evaluation experience.

Thanks

Thamiz

Similar jobs