Data engineer with AI

Data engineer with AI

Location: Cupertino, CA, USA

Duration: 12 Months + Extension

Bill Rate: $95/hr on C2C

Job Type: C2C/1099 Contract

Client: To Be Discussed Later

Work Authorization: US-Citizen, H-1B, OPT-EAD, GC-EAD

Job Description:

• Design, develop, and deploy Agentic AI solutions to automate data governance and data management processes.
• Build scalable AI agents using LLMs, RAG, prompt engineering, and orchestration frameworks.
• Develop autonomous and human-in-the-loop agents for:
  • Data cataloging
  • Business glossary management
  • Data ownership assignment
  • Policy compliance validation
  • Data quality issue remediation
  • Governance workflow automation
• Automate metadata management, data lineage analysis, data quality controls, policy enforcement, and stewardship workflows.
• Integrate AI agents with enterprise platforms including Collibra, Ataccama, Informatica, Microsoft Purview, Databricks, Snowflake, AWS, and Azure.
• Develop APIs, workflow orchestration, event-driven architectures, and enterprise system integrations.
• Partner with Data Engineers, Data Governance Engineers, Architects, and business stakeholders to identify and prioritize governance use cases.
• Create proof-of-value (POV) demonstrations and pilot implementations to validate AI-driven governance solutions.
• Implement monitoring, observability, guardrails, security, compliance, and responsible AI controls.
• Support architecture discussions, requirements gathering, effort estimation, proposal development, and client presentations.
• Collaborate with delivery teams and stakeholders to manage governance backlogs and continuously improve AI solutions.
• Develop reusable frameworks, accelerators, and best practices for enterprise Agentic AI and data governance implementations.
• Work within Agile environments using iterative development, backlog management, and stakeholder feedback.
  Required Qualifications:
• 8+ years of experience in Data Management, Data Engineering, Data Governance, Metadata Management, or Enterprise Data Architecture.
• 5+ years of experience with enterprise Data Governance, MDM, Metadata Management, Data Quality, or Regulatory Compliance.
• 3+ years of experience developing AI/ML, Generative AI, or Agentic AI solutions.
• 3+ years of hands-on experience with Python.
• 3+ years of experience with AI development/orchestration frameworks such as LangChain, LangGraph, Semantic Kernel, AutoGen, CrewAI, OpenAI, Azure AI Foundry, or Amazon Bedrock.
• 3+ years of experience with LLMs and RAG.
• 3+ years of experience working with AWS, Azure, or Google Cloud Platform.
• 2+ years of experience integrating Collabra, Databricks Unity Catalog, Informatica, Microsoft Purview, or similar data governance platforms.
• 2+ years of experience with API development, workflow orchestration, event-driven architecture, or enterprise integrations.
• Strong understanding of data governance policies, data lineage, data quality, metadata, stewardship, and compliance monitoring.
• Experience working in Agile/Scrum delivery environments.
• Excellent communication and client-facing skills.
• Experience building enterprise-scale Agentic AI platforms and accelerators.
• Experience implementing multi-agent workflows and autonomous AI solutions.
• Experience integrating AI agents with enterprise data catalogs and governance platforms.
• Knowledge of AI governance, Responsible AI, AI security, guardrails, and model governance.
• Experience developing POCs/POVs and taking AI solutions into production.
• Strong experience conducting client workshops and architecture presentations.

Excellent problem-solving, communication, and stakeholder management skills