Quick Overview
Job Description
Role Overview
We are seeking a detail-oriented Data Analyst with Azure storage experience to support OCR processing and the management of large document and text datasets used for AI model training.
This role focuses on monitoring existing OCR pipelines, reviewing generated data, maintaining accurate metadata and inventories, and managing Azure uploads and downloads. The analyst will work closely with engineers and applied scientists to identify issues, coordinate reprocessing, and ensure datasets are complete, organized, and ready for downstream use.
Key Responsibilities
OCR Pipeline Monitoring
- Operate existing OCR workflows using established tools and procedures.
- Monitor processing queues, job status, completion rates, and failed or stalled batches.
- Review logs and processing reports to identify exceptions; perform documented recovery steps and escalate technical issues to engineers.
- Maintain batch tracking records and coordinate reruns, priorities, and outstanding processing tasks.
- Review OCR outputs against source documents using sampling and established quality criteria.
- Identify missing pages, empty outputs, duplicate records, unreadable text, formatting problems, and incomplete content.
- Run existing cleaning and validation tools; review results and flag questionable changes for further investigation.
- Maintain issue logs, categorize recurring errors, and track corrections through resolution.
- Summarize quality trends and recommend improvements to review procedures and data handling.
- Maintain inventories linking source documents, OCR outputs, cleaned data, and dataset versions.
- Validate metadata such as document identifiers, titles, subjects, languages, page counts, and processing status.
- Reconcile batch manifests and tracking records against actual files to identify missing, mismatched, or duplicate items.
- Organize generated data using agreed folder structures, naming conventions, and versioning standards.
- Prepare dataset delivery packages with manifests, quality summaries, and documented exceptions.
- Manage uploads, downloads, and transfers of source files and generated datasets in Azure storage.
- Verify transfer completion, file counts, and integrity using established tools and reports.
- Investigate routine transfer failures, incorrect paths, and access issues; coordinate with administrators when needed.
- Follow approved access, retention, and data-sharing procedures; maintain records of dataset deliveries and changes.
- Maintain operational trackers and dashboards covering processing progress, backlog, quality, and dataset readiness.
- Provide concise updates on completed batches, unresolved issues, and delivery risks.
- Maintain standard operating procedures and support handoffs between data operations, engineering, and model-training teams.
- B.S degree
- Hands-on experience with cloud storage, including file organization and uploads/downloads.
- Experience checking data completeness, accuracy, consistency, and metadata quality.
- Ability to use existing dashboards, processing tools, and logs to monitor workflows and investigate exceptions.
- Familiarity with common document and data formats, including PDF, text, CSV, and JSON.
- Strong attention to detail, documentation skills, and clear communication.
- Ability to manage repetitive validation tasks consistently while prioritizing exceptions and following issues through resolution.
Preferred Qualifications
- Experience with AI training-data operations.
- Familiarity with Azure Storage Explorer, AzCopy, or comparable file-transfer tools.
- Basic SQL skills for querying, validation, and reconciliation.
- Basic Python knowledge to run existing scripts or make small adjustments; advanced coding is not required.
- Experience with Power BI or similar operational reporting tools.
- Familiarity with dataset versioning, source traceability, access controls, and human-review workflows.
What is the ideal background of a candidate for this role?:
- Experience in data analysis, data operations, data quality assurance, or dataset management.
- Hands-on experience with Cloud storage, including file organization and uploads/downloads.
- Experience checking data completeness, accuracy, consistency, and metadata quality.
- Ability to use existing dashboards, processing tools, and logs to monitor workflows and investigate exceptions.
- Familiarity with common document and data formats, including PDF, text, CSV, and JSON.
- Strong attention to detail, documentation skills, and clear communication.
- Ability to manage repetitive validation tasks consistently while prioritizing exceptions and following issues through resolution.
How will contractor performance be measured?: Data quality and risk mitigation
Where is the work able to be performed?: Onsite
If Onsite or HWA required, indicate why: Preference / collaboration / convenience
- Best vs.
Average: The ideal resume would show prior similar or other big tech experience, experience with Azure/cloud storage, and actual hands-on experience working with data. Candidates should also demonstrate the ability to anticipate risks
Top 3 Must-Have HARD Skills & years of experience for each:
Minimum 2 years experience!
- Experience in data analysis, data operations, data quality assurance, or dataset management.
- Hands-on experience with Cloud storage, including file organization and uploads/downloads.
- Familiarity with common document and data formats, including PDF, text, CSV, and JSON
Similar jobs
- RI

Data Analyst
NewRivago infotech inc
Mountain View, CA🇺🇸On-site18 hours agoStakeholder ManagementSQLData Pipeline+2Technology - VA

Data Analyst Sr
NewAuto ApplyValtech
United States - Remote🇺🇸Remote4 hours agoTalent AcquisitionSQLMicrosoft Excel+12Technology - TC
Y Analytics, Climate Impact, Associate
NewAuto ApplyTPG Careers Page
Washington🇺🇸Hybrid1 hour agoMicrosoft PowerPointData Analysis - ST

Data Analyst Intern - Summer 2027
NewAuto ApplySTR
Arlington🇺🇸Hybrid2 hours agoSQLMicrosoft ExcelMicrosoft Office+9Technology - SE

Manager, Analytics and Data Strategy
NewAuto ApplySecretariat
Chicago🇺🇸Hybrid4 hours agoSQLMicrosoft ExcelMicrosoft Office+8 - PS
Manager, Data and Analysis
NewAuto ApplyPostpartum Support International
Remote🇺🇸Remote1 hour agoCRMCall CenterCompliance+5 - AI

Senior Analyst, Growth Strategy & Operations (Funnel & Analytics)
NewAuto ApplyAirwallex
US - San Francisco🇺🇸Hybrid2 hours agoOnboardingSQLLooker+12 - MN

Principal Strategist, Ad Measurement
NewAuto ApplyMNTN
United States🇺🇸Hybrid2 hours agoCustomer SuccessBusiness Development - EL

Principal, Marketing Analytics
NewAuto ApplyElastic
United States🇺🇸Hybrid3 hours agoSQLBigQueryCompliance+9Marketing - CO
Sr. Data Analyst, Business Intelligence-Xumo
NewComcast
Irvine, California🇺🇸$89.7k - $119.6k/yrHybrid2 hours agoSQLAWSLinear+5Technology - AC
Senior Data Analyst - Statistics
NewAvenue Code, LLC
United States🇺🇸Hybrid18 hours agoSQLMicrosoft ExcelPython+1Technology - AC
Senior Data Analyst - Data
NewAvenue Code, LLC
United States🇺🇸Hybrid18 hours agoSQLMicrosoft ExcelPython+1Technology
