4356 Data Scientist with Security Clearance

OVERVIEW: As the Data Scientist, you will report to the onsite Project Team leader and work closely with a small exercise support team. You will own problems end-to-end, to include designing evaluation frameworks, improving prompts and retrieval pipelines, analyzing interview data, and shipping measurable improvements into production. GENERAL DUTIES: LLM Quality & Evaluation * Improve prompting strategies and structured outputs across reporting formats * including law enforcement, intelligence, after-action, interview summaries, and * survey analysis * Design evaluation sets, scoring rubrics, and automated evaluation pipelines * (including LLM-as-judge approaches) for relevance, coherence, completeness, * and error modes * Reduce hallucinations and improve traceability and attribution RAG & Knowledge Pipelines * Build and iterate on RAG pipelines, curated knowledge packs, and question-tree * triggers * Create and maintain base datasets (follow-up triggers, Essential Elements of * Information/Critical Information Requirements, glossaries, watchlist cues) with * versioning and documentation * Tune retrieval and reranking to perform reliably under edge constraints (limited * compute, memory, and connectivity) Interview Analytics * Analyze transcripts to surface evasiveness, inconsistencies, and actionable leads * Develop labeling strategies, analytic rubrics, and ground-truth datasets * Conduct quantitative and qualitative analysis of interview data to identify patterns * and support operational decisions Measurement & Documentation * Build lightweight dashboards and metrics for model performance and field * reliability * Document methods and maintain audit trails so outputs remain defensible for * government end users * Partner with engineering to validate and ship improvements into production REQUIRED QUALIFICATIONS: * 2-5 years of applied data science or NLP experience * Strong Python skills (pandas, NumPy, scikit-learn) with comfort standing up * experiments and pipelines * Hands-on experience with LLMs: prompt engineering, output evaluation, safety, * and quality controls * Experience with unstructured text data - cleaning, labeling, building evaluation * metrics * Proficiency in data analysis, reporting, and visualization for technical and non- * technical audiences * Ability to work on-site in the El Paso / Las Cruces / WSMR area DESIRED QUALIFICATIONS: * RAG implementation experience (vector databases, embeddings, reranking) * Experience with structured evaluation frameworks (RAGAS, custom LLM-as- * judge, or equivalent) * Familiarity with edge or offline deployment constraints * Exposure to interview analytics, structured debriefing, structured reporting, or * HUMINT-adjacent workflows * Experience delivering in classified or regulated environments CLEARANCE: * Active Secret clearance