Haystack
← Back to Jobs
Remote
Technology
HP

Conversational Data Engineer

HPTech Inc.United States🇺🇸United StatesPosted 9 Sept 2026

Why This Role Stands Out

This remote role offers an exciting opportunity to shape the future of conversational AI by building robust RAG and knowledge pipelines with high-impact synthetic data. You'll thrive here if you're a skilled data engineer passionate about innovation and eager to contribute to cutting-edge technology within a reputable company. Apply now to leverage your expertise and grow your career in this dynamic field.

Quick Overview

Seniority
Mid Senior
Work mode
Remote
Location
United States
Posted
21 hours ago
AWSNLPBigQueryGoogle Cloud

Job Description

Conversational Data Engineer

Job Location: Remote USA

 

Job Requirements Role summary:

Create high-quality, customer-specific synthetic data and own RAG / knowledge pipelines so each deployment of CCAI, voice, and chat can be configured, grounded, demonstrated, and validated without using real customer PII.You design generation and ingestion pipelines and load data into the correct Google Cloud Platform and AWS services.What success looks likeEach customer engagement has a documented synthetic dataset covering the channels in scope • Each in-scope customer has a working RAG / knowledge pipeline: corpus prepared, indexed, retrievable,and evaluated.Data and retrieval quality are good enough for configuration, evaluation, and stakeholder demos, andsafe enough for isolation and compliance expectations.Generation and indexing are parameterized and repeatable, not a one-off manual copy-paste percustomer.Key responsibilitiesAnalyze each customer’s domain: intents, entities, knowledge topics, document types, languages, tone,and edge cases.Generate synthetic conversation transcripts for voice and chat, plus CCAI training/evaluation dialogues.Generate supporting content: customer/agent profiles, knowledge-base articles, FAQs, and structuredentity values.Schedule and document index refresh processes when customer knowledge changes.Use appropriate techniques whiledocumenting parameters and limitations.Validate realism, coverage, diversity, and absence of residual real-world PII in synthetic data and sourcecorpora.Maintain reusable generators, ingestion jobs, and quality checklists that can be parameterized percustomer.Partner with the Conversational Platform Specialist so loaded data and indexes actually drive thedeployed experience.Partner with DevOps so pipeline jobs, stores, and secrets are automated and isolated per customer.Required qualifications4+ years in data engineering, conversation design operations, applied NLP data work, or knowledge-pipeline engineering.Working knowledge of how conversational platforms consume training, FAQ, transcript, and retrieval-grounded knowledge data.Strong judgment on synthetic-data quality, retrieval quality, and privacy safety.Preferred qualificationsLLM-assisted synthetic data generation in a production or implementation setting.Familiarity with BigQuery, S3, and document stores used as knowledge sources.Multilingual data generation or evaluation experience

Similar jobs