Quick Overview
Seniority
Mid Senior
Location
San Francisco Bay Area, United States
Posted
4 months ago
Airflow
Job Description
We are seeking a talented and innovative Synthetic Data Engineer. In this role, you will design and implement domain-specific synthetic data generation pipelines, ensuring high-quality data management for training loops. Your expertise will drive the success of data processing and model training within the organization.
Responsibilities:
- Design domain-specific synthetic data generation (SDG) pipelines via self-instruct and constitutional prompting.
- Implement automated quality scoring and de-duplication systems.
- Manage data pipelines that feed directly into SFT and DPO training loops.
Qualifications:
- Proven experience building large-scale data pipelines (Airflow, Spark, Ray).
- Deep knowledge of prompt engineering for data generation.
- Familiarity with dataset distillation and bias mitigation.
Similar jobs
- HI
.Net Developer
NewHAN IT Staffing Inc.
Plano, TX🇺🇸HybridYesterdayAWSAgileC#+1Technology - OR
Mainframe Database Specialist
NewOrangePeople
TX🇺🇸HybridYesterdayAccount ManagementComplianceContinuous ImprovementTechnology - RT
Network Operations Engineer - Fully Onsite in Columbia, SC - Only Permanenet Residents can apply
NewRICEFW Technologies Inc
Columbia, SC🇺🇸On-siteYesterdayTCP/IPAnsiblePythonTechnology - AC
Software Development Program Manager/Remote
NewApetan Consulting
United States🇺🇸RemoteYesterdayScrumAgileConfluence+1Technology - TR
SAP Data Governance -- 100% Remote -- Only W2 Profiles
NewTrebecon LLC
United States🇺🇸RemoteYesterdayAgileJiraSAPTechnology - KT
Technical Solutions Architect - CMS
NewKforce Technology Staffing
New York, NY🇺🇸RemoteYesterdayMicroservicesAWSGenerative AI+1Technology