Quick Overview
Job Description
• 7+ years of relevant experience
• Experience in database design and management of database transformation and/or migration projects for software applications
Technical Skills Languages: SQL, Python, PySpark/Spark
Databricks: Delta Lake, Delta Live Tables, Unity Catalog, Workflows, Structured Streaming, SQL Warehouses
•
• AWS data services: S3, Glue, Lambda
• ETL/ELT, streaming ingestion, and API-based data exchange
• Data quality, metadata, and lineage tools (e.g., Unity Catalog lineage, data quality frameworks)
• Databases: PostgreSQL, Aurora, DynamoDB
Preferred AI Skills & Techniques
AI-driven data quality checks: anomaly detection, schema-drift detection, and bias checks on training data
Preparing AI-ready data: feature engineering, labeled training datasets, and semantic embeddings
• ML-based entity resolution, record matching, and data enrichment
• NLP/LLM techniques for automated metadata tagging, classification, and entity/relationship extraction
• Databricks AI features: Delta Live Tables, Unity Catalog lineage, and feature stores
Similar jobs
- SH
Consumer Insights Analyst
NewSharkNinja
Needham🇺🇸Hybrid11 hours agoAgileMarket Research - AF
Senior Data Analyst
NewAtomic Financial
Remote🇺🇸Remote10 hours agoSQLLookerTableau+3Technology - VI
Data Analyst, Commercial Analytics
NewVirtahealth
Remote🇺🇸Remote10 hours agoSQLAWSLooker+2Technology - TR
Senior Manager, Risk & Fraud Analytics
NewTrustly
San Francisco🇺🇸HybridYesterdayComplianceForecastingPython+2 - OP
Staff Analyst - Insurance Product & Countrywide Advanced Analytics (Remote, US)
Openly
Remote - United States🇺🇸Remote4 weeks agoSQLTableauPython+3 - RH
Data Analyst
NewRobert Half
Westerville, OH🇺🇸HybridYesterdayTechnology