Why this role stands out
This role offers a fantastic opportunity to leverage your expertise in conversational AI analytics and contribute to cutting-edge projects within a reputable regulatory client. You'll thrive here if you're a data scientist eager to build sophisticated clustering pipelines, extract insights from complex data, and directly influence product development. Apply now to join a team where your analytical skills will drive significant impact.
Quick overview
Job description
The Data Scientist (Conversational AI Analytics) develops analytics and derives insights from conversational data generated by AI-powered platforms. This role is responsible for designing clustering pipelines, building facet extraction workflows, and producing actionable intelligence on how users interact with chat systems. The Data Scientist works closely with engineers and stakeholders to surface usage patterns, identify emerging topics, and inform product decisions through data.
Responsibilities :
Conversation Analytics & Insight Generation
- Design and implement analytics pipelines that extract meaningful patterns from large-scale chat conversation data
- Develop facet extraction approaches using LLMs to categorize conversations by request type, task performed, and topic discussed
- Build dashboards and reporting artifacts that communicate usage trends, emerging topics, and user behavior to stakeholders
- Identify and quantify shifts in conversation patterns over time to inform product roadmap and content strategy
- Translate analytical findings into actionable recommendations for platform improvement
- Architect and optimize hierarchical clustering pipelines using density-based algorithms (e.g., HDBSCAN) to group conversations by semantic similarity
- Generate and manage text embeddings at scale using embedding models for downstream clustering and similarity tasks
- Design multi-level clustering strategies that produce both granular groupings and higher-order category taxonomies
- Evaluate cluster quality using persistence metrics, silhouette analysis, and domain-informed validation
- Experiment with clustering parameters, distance metrics, and dimensionality reduction techniques to improve grouping coherence
- Build and maintain data pipelines using Python for ingesting, transforming, and analyzing conversation datasets
- Develop automated workflows using cloud-native orchestration and compute services to run analytics at scale on scheduled cadences
- Work with object storage, search engines, and relational databases to store and query analytical outputs
- Implement caching, batching, and incremental processing strategies to handle large embedding and clustering workloads efficiently
- Maintain reproducible analysis environments and version analytical artifacts (models, cluster outputs, embeddings)
- Design and refine LLM prompts for facet extraction, cluster labeling, and conversation summarization
- Evaluate LLM output quality for analytical tasks and iterate on prompt strategies to improve accuracy
- Leverage model infrastructure for embedding generation and LLM inference
- Explore emerging techniques in LLM-driven data analysis, topic modeling, and automated insight generation
- Develop evaluation frameworks to measure clustering quality, facet extraction accuracy, and analytical pipeline correctness
- Build automated regression tests to detect drift in clustering outputs or degradation in categorization quality
- Validate analytical results against known baselines and domain expertise
- Document methodologies, assumptions, and limitations of analytical approaches
- Assist with adherence to technology policies and comply with all security controls
- Implement secure coding practices, particularly in handling personally identifiable information (PII) and sensitive data
- Participate in threat modeling and security discussions for API and infrastructure components
- Understand and apply organizational security standards and best practices
SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company to request an accommodation or assistance regarding our policy.
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- AI

Senior Data Software EngineerRecently posted Auto Apply
Airbnb · United States · Hybrid · Posted 20 Nov 2026 🇺🇸
SQLScalaETL+3Technology$196k - $227k/yr - SG

Lead Data EngineerRecently posted
Software Guidance & Assistance · Rockville, MD · Hybrid · Posted 21 Nov 2026 🇺🇸
Stakeholder ManagementSQLApache Spark+7TechnologySalary not listed - CL

Lead Data EngineerRecently posted
ClifyX · Atlanta, GA · On-site · Posted 20 Nov 2026 🇺🇸
SQLGitApache Spark+9TechnologySalary not listed - TM

Data Engineer--cloud security or cloud infrastructureRecently posted
Tech Mahindra (Americas) Inc. · Milpitas, CA · On-site · Posted 20 Nov 2026 🇺🇸
AWSEncryptionCDK+5TechnologySalary not listed - AT

Data Engineer
Aivanta Tech Inc · Texas City, TX · Hybrid 🇺🇸
SQLApache SparkAWS+8TechnologySalary not listed - KE

Senior Data EngineerRecently posted
Kentro · United States · On-site · Posted 20 Nov 2026 🇺🇸
DockerSQLT-SQL+12Technology$158k - $175k/yr - ST

AWS Data Engineer - W2 ContractRecently posted
SDVS Technologies LLC · United States · Hybrid · Posted 20 Nov 2026 🇺🇸
AWSLLMGenerative AI+1TechnologySalary not listed - SE
SQL Server DBARecently posted
SeersolutionsInc · Washington, DC · Hybrid · Posted 20 Nov 2026 🇺🇸
DockerMySQLSQL+11TechnologySalary not listed - GE

Data Engineer - RemoteRecently posted
Genesis10 · Charlotte, NC · Remote · Posted 20 Nov 2026 🇺🇸
SQLAWSETL+3Technology$63/hr - PG

Senior Data EngineerRecently posted
PTR Global · Richmond, VA · Hybrid · Posted 20 Nov 2026 🇺🇸
SQLScalaGit+10Technology$70 - $80/hr - DT
Data Engineer (Azure) - Lansing, MIRecently posted
Digital Technology Solutions · Lansing, MI · Hybrid · Posted 20 Nov 2026 🇺🇸
Stakeholder ManagementSQLT-SQL+7TechnologySalary not listed - ME

DataBricks Data Engineer - Montvale, NJ (3x Hybrid)Recently posted
MetaSense, Inc. · Montvale, NJ · On-site · Posted 20 Nov 2026 🇺🇸
SQLGitApache Spark+11TechnologySalary not listed