Haystack
← Back to Jobs
Technology
TE

Senior Data Engineer (Agentic Retrieval & Memory)

TekShapersOaks, PA🇺🇸United StatesPosted 1 Sept 2026

Quick Overview

Seniority
Mid Senior
Work mode
On Site
Location
Oaks, PA, United States
Posted
10 hours ago
AzureLLMPythonRedis

Job Description

Senior Data Engineer – Agentic Retrieval & Memory

Location: Oaks, PA
Type: Long-Term Contract
Experience: 10+ Years
Work Model: Hybrid – Onsite from Day 1

 

Seeking a Senior Data Engineer with 10+ years of experience, including 5+ years in data engineering and strong hands-on experience with Agentic AI/LLM data, memory, and retrieval systems.

 

Key Responsibilities

  • Design and implement agent memory across session, conversation, and long-term memory tiers.
  • Build scalable solutions using Redis, NoSQL/document stores, and vector databases.
  • Design and optimize retrieval and semantic search for enterprise AI applications.
  • Evaluate data stores for performance, scalability, latency, retention, and cost.
  • Support RAG, embeddings, chunking, and retrieval quality.
  • Build production-grade data interfaces and libraries using Python.

 

Required Skills

  • 5+ years Data Engineering with strong data modeling, storage, and query optimization experience.
  • 3+ years Agentic AI/LLM data experience, specifically agent memory, conversation state, summarization, retention, and user/thread isolation.
  • 3+ years Vector/Semantic Search with Azure AI Search, pgvector, Elasticsearch, or similar.
  • Strong NoSQL, Document/Key-Value databases, Redis, caching, partitioning, TTL, and high-volume workloads.
  • Strong Python development experience.
  • Experience with RAG, embeddings, chunking, and retrieval evaluation.
  • Cloud experience with managed data services, identity/access, and private networking.

 

 

Tekshapers is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.

Similar jobs