Quick Overview
Seniority
Mid Senior
Location
Boston, United States
Posted
4 months ago
Airflow
Job Description
We are seeking a talented and innovative Synthetic Data Engineer. In this role, you will design and implement domain-specific synthetic data generation pipelines, ensuring high-quality data management for training loops. Your expertise will drive the success of data processing and model training within the organization.
Responsibilities:
- Design domain-specific synthetic data generation (SDG) pipelines via self-instruct and constitutional prompting.
- Implement automated quality scoring and de-duplication systems.
- Manage data pipelines that feed directly into SFT and DPO training loops.
Qualifications:
- Proven experience building large-scale data pipelines (Airflow, Spark, Ray).
- Deep knowledge of prompt engineering for data generation.
- Familiarity with dataset distillation and bias mitigation.
Similar jobs
- DS
Back of House (BOH) Support Engineer – Crunchtime
NewDatum Software, Inc.
Atlanta, GA🇺🇸Remote23 hours agoSQLTableauPower BI+3Technology - ZC
Senior Business System Analyst, onsite - HealthCare
NewZtek Consulting
Mason, OH🇺🇸On-site23 hours agoAgileComplianceHIPAA+1Technology - DS
Data Analyst
NewDew Softech Inc
Trenton, NJ🇺🇸Hybrid23 hours agoSQLAWSSnowflake+1Technology - TE
Snowflake SQL, Python Data Analyst - Hybrid (3 days/week) - Long Term Contract - Trenton, NJ - B4206B
NewTechnovision, Inc.
Trenton, NJ🇺🇸Hybrid23 hours agoSQLAWSSnowflake+1Technology - RS
Senior ETL Developer
NewRuri Software Technologies LLC
Alexandria, VA🇺🇸On-site23 hours agoSQLETLScrum+2Technology - CO
ML Engineer
ConnectedX, Inc.
Plano, TX🇺🇸Remote2 weeks agoDockerSQLAWS+16Technology