Quick overview
Job description
The Staff Data Engineer is a hands-on role and will be the primary architect and technical lead for the data infrastructure powering our next-generation Agentic AI products. Acting as a hands-on leader, you are responsible for the team’s overall delivery, translating complex product requirements into actionable technical tasks for a small engineering squad. You will design the multi-modal data stores (Vector and Graph) that serve as the Active Memory for autonomous agents while remaining deeply embedded in the codebase to drive execution.
Key Responsibilities
Technical Execution: Lead the technical delivery by translating high-level product roadmaps into actionable development cycles. You will own the task breakdown and manage the workflow to ensure high-quality output from the team
Strategic Data Architecture: Architect and directly implement multi-modal data pipelines that process structured parts catalogs and unstructured sources (PDFs, Word, PNG/SVG diagrams) into specialized Vector and Graph data stores.
Knowledge Layer Development: Design and optimize the storage of embeddings in Vector Databases (e.g., Pinecone, ChromaDB, Vertex AI Search) and Graph Databases (e.g., FalkorDB, Neo4j) to enable multi-step agentic reasoning across disparate data sources.
Agent-Driven Development: Deeply integrate autonomous coding agents into your daily workflow to plan, generate, and refactor data infrastructure and microservices.
Evaluation Pipelines: Collaborate with AI Engineers to build Gold Dataset pipelines used for the automated verification, retrieval quality measurement, and confidence scoring of AI outputs.
Microservices: Develop and maintain scalable data services and RESTful APIs using Python (FastAPI/Django) to provide structured, validated data.
Cloud Operations: Deploy and monitor high-scale data workloads on Google Cloud Platform (Vertex AI, BigQuery), ensuring system reliability, security, and cost-effectiveness
Skills and Experience
10+ years of Software/Data Engineering experience, with a proven history of leading technical teams.
Proven track record of designing and building production-grade AI data systems.
Technical Stack: Advanced Python (FastAPI, Pydantic, SQLAlchemy) and SQL mastery for building scalable microservices.
AI: Hands-on experience with Vector Databases (Pinecone, ChromaDB), RAG pipelines, and GraphRAG patterns.
Data Tooling: Deep experience with Prefect (preferred) or Apache Airflow or Cloud Composer, BigQuery, and DataProc.
Cloud Infrastructure: Experienced in working with cloud platforms (Google Cloud Platform, AWS) and deploying data workloads and pipelines at scale.
Coding Agent: Demonstrated proficiency in using coding agents to accelerate the SDLC and plan and code complex engineering tasks.
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- EG

Data Engineer with Security ClearanceRecently posted
Eliassen Group · Saint Louis, MO · On-site · Posted 18 Nov 2026 🇺🇸
GCPSQLScala+10TechnologySalary not listed - SI

Data Engineer -- 2/3 days a Week in Dayton, OH -- Only W2Recently posted
Siri Infosolutions Inc · Trotwood, OH · On-site · Posted 19 Nov 2026 🇺🇸
ETLAzureTechnologySalary not listed - GD

NCIS Data Engineer | Active Secret clearance
General Dynamics Information Technology · Quantico, VA · Hybrid 🇺🇸
DockerPL/SQLSQL+14Technology$142.8k - $166.8k/yr - BA

Mid Data EngineerRecently posted
Booz Allen Hamilton · Fort Belvoir, VA · On-site · Posted 18 Nov 2026 🇺🇸
DockerSQLGit+17Technology$62k - $141k/yr - ZP

Senior Data Engineer with Security ClearanceRecently posted
Zachary Piper Solutions, LLC · Honolulu, HI · On-site · Posted 19 Nov 2026 🇺🇸
Microsoft ExcelGitApache Spark+16Technology$120k - $180k/yr - EG

Data Engineer - PlatformRecently posted
Eliassen Group · Glendale, CA · On-site · Posted 20 Nov 2026 🇺🇸
SQLScalaScrum+5Technology$74 - $84/hr - PE

Mid-Level Data Engineer / Active Top Secret with SCI and Polygra with Security ClearanceRecently posted
Peraton · Washington, DC · On-site · Posted 19 Nov 2026 🇺🇸
ETLData PipelineData AnalysisTechnology$86k - $138k/yr - BA

Data EngineerRecently posted
Booz Allen Hamilton · Charlottesville, VA · On-site · Posted 19 Nov 2026 🇺🇸
SQLAWSETL+8Technology$99k - $225k/yr - GA

Staff Data EngineerRecently posted
GE Aerospace · United States · Remote · Posted 19 Nov 2026 🇺🇸
SQLGitApache Spark+8Technology$112k - $150k/yr - BA

Data Engineer with Security ClearanceRecently posted
Booz Allen Hamilton · Charlottesville, VA · On-site · Posted 19 Nov 2026 🇺🇸
SQLAWSETL+8Technology$99k - $225k/yr - RD

Data Systems EngineerRecently posted
Randstad Digital · Marietta, OH · Hybrid · Posted 20 Nov 2026 🇺🇸
SQL.NETC+++1Technology$38 - $41/hr - BA

Data EngineerRecently posted
Booz Allen Hamilton · Washington, DC · On-site · Posted 20 Nov 2026 🇺🇸
SQLETLIoT+5Technology$62k - $141k/yr