Principal AI Data Engineer with World Leading Energy Company

Exciting Opportunity for an Experienced Principal AI Data Engineer to help build and scale GenAI and agentic AI solutions as part of a new project for a Leading Energy Company.

Responsibilities:

• Build and evaluate GenAI/Agentic AI prototypes (Copilot Studio, Azure AI Foundry, Databricks Mosaic AI, Genie, MLflow)
• Design and tune RAG systems — embeddings, prompt engineering, evaluation
• Build AI agents using LangChain, LangGraph, AutoGen, and similar frameworks
• Deploy models via Azure OpenAI, Azure AI Foundry, and Docker
• Write clean, modular Python (OOP, Pydantic, PyTorch) following solid DevOps/CI-CD practices
• Manage large-scale text and structured datasets on Databricks
• Partner closely with commercial stakeholders to align AI solutions with business needs

Key Skills:

• 8-12+ years' experience delivering large scale Data science or AI Projects
• Strong knowledge of LLMs (GPT, Llama, Claude, Mistral) and their reasoning capabilities
• Deep Databricks experience (DLT, Delta Lake, Unity Catalog governance)
• Solid grasp of streaming technologies (Spark Structured Streaming, Autoloader)
• Python, SQL, or Scala proficiency
• Experience with ETL/ELT, data modelling, and data architecture
• Azure cloud experience

With a focus within Energy Trading, Oil & Gas, Financial Markets and Commodities, we offer a transparent Recruitment Service that has proven to be reliable and effective for over 40 years. We are ISO accredited and proud of our excellent TrustPilot Reviews.

Eaglecliff Ltd is acting in the capacity of an employment agency for permanent recruitment and an employment business for contractor resourcing.