W2// AI Data Analyst (Agentic AI)

Role Name: AI Data Analyst (Agentic AI)

Work site: Charlotte, US (Onsite)

Employment Type: Contract

Job Description

AI Data Analyst

Experience: 8+ years

About the Role

We are seeking an experienced AI Data Analyst to analyze data, generate insights, and support the development and evaluation of AI/ML and generative AI solutions. This role bridges traditional data analysis with emerging AI capabilities — helping teams make data-driven decisions and assess the performance and impact of AI systems.

Key Responsibilities

Analyze structured and unstructured data to identify trends, patterns, and actionable insights

Support evaluation of AI/ML and generative AI model outputs (accuracy, quality, bias, relevance)

Design and build dashboards and reports to track AI system performance and business KPIs

Partner with data scientists and AI engineers to define metrics for model evaluation and monitoring

Write and optimize SQL queries to extract and transform data from various sources

Perform exploratory data analysis (EDA) to support model development and feature identification

Assist in labeling, curating, and validating datasets used for training and fine-tuning AI models

Translate business requirements into analytical frameworks and present findings to stakeholders

Identify data quality issues and work with engineering teams to resolve them

Stay current on AI/ML trends relevant to data analysis and reporting

Required Qualifications

5+ years of experience in data analysis, business intelligence, or related analytics roles

Strong proficiency in SQL and data querying/transformation

Experience with Python (pandas, NumPy) or R for data analysis

Experience with BI/visualization tools (Tableau, Power BI, Looker, or similar)

Understanding of AI/ML concepts and exposure to evaluating model outputs or working alongside ML teams

Strong statistical analysis skills

Excellent communication skills — able to translate data insights for both technical and non-technical stakeholders

Experience working with large datasets in cloud data warehouses (BigQuery, Snowflake, Redshift)

Preferred Qualifications

Experience evaluating generative AI/LLM outputs (prompt quality, hallucination detection, response scoring)

Familiarity with Google Cloud Platform data tools (BigQuery, Looker, Vertex AI)

Experience with A/B testing and experimentation frameworks

Background in data governance or data quality frameworks

Exposure to Python-based ML libraries (scikit-learn) a plus

Good to have

Google Cloud Platform, Vertex AI, Data Modeling, ETL/ELT, Data Quality, Data Visualization, Prompt Engineering, RAG, Cloud Storage, Dataflow