Quick overview
Job description
We are hiring a Data Scientist with strong Applied AI experience to develop, test, and improve intelligent applications powered by Large Language Models. The role focuses on building reliable AI solutions, optimizing retrieval-based architectures, and establishing systematic evaluation approaches for LLM-generated outputs. Candidates should have strong Python and analytical capabilities, along with practical experience in model benchmarking, automated quality assessment, and human-assisted evaluation. Familiarity with modern AI orchestration frameworks and cloud-based ML platforms is expected.
Roles & Responsibilities
- Develop and enhance intelligent applications using Large Language Models, advanced prompting strategies, Python-based data processing, and enterprise AI APIs.
- Design retrieval-based AI solutions by implementing embedding generation, vector search, document indexing, context retrieval, and response optimization techniques.
- Establish model assessment methodologies to measure the consistency, factual accuracy, relevance, and overall performance of GenAI applications.
- Implement automated evaluation pipelines using LLM-as-a-Judge, human feedback mechanisms, and frameworks such as RAGAS, DeepEval, TruLens, and LangSmith.
- Analyze model performance using quantitative measures, including precision, recall, F1-score, retrieval quality, groundedness, and response relevance.
- Develop multi-step AI workflows and intelligent agent solutions using LangGraph, LangChain, and other orchestration technologies.
- Perform exploratory data analysis, benchmarking, and evaluation reporting using Python, Pandas, SQL, Excel, and relevant ML experimentation tools.
- Integrate AI monitoring, experiment tracking, evaluation logging, and model performance analysis using MLflow, Databricks, Arize AI, and AWS services.
Similar jobs
- MR

Staff Data Scientist (Remote EST)Recently posted
Motion Recruitment Partners, LLC · Boston, MA · Remote · Posted 17 Nov 2026 🇺🇸
TechnologySalary not listed - SC

Senior Data ScientistRecently posted
SNI Companies · Almont, CO · On-site · Posted 16 Nov 2026 🇺🇸
DockerOracleApache Spark+16Technology$70 - $80/hr - BA

Advanced Data Scientist & Researcher, Mid with Security ClearanceRecently posted
Booz Allen Hamilton · Albuquerque, NM · On-site · Posted 17 Nov 2026 🇺🇸
SQLApache SparkScikit-learn+10Technology$69.4k - $158k/yr - VA

Data ScientistRecently posted
Vantor · Herndon, Virginia · Hybrid · Posted 17 Nov 2026 🇺🇸
PythonMachine LearningData Analysis+1TechnologySalary not listed - SG

Lead Data ScientistRecently posted
S&P Global · New York, NY · Hybrid · Posted 17 Nov 2026 🇺🇸
TableauDatabricksHadoop+2Technology$189.5k - $206.3k/yr - EW

Lead Product Data Scientist - PazeRecently posted
Early Warning Services, LLC · New York, NY · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLScikit-learnHadoop+6Technology$149k - $198k/yr - AB

Member of Data Science StaffRecently posted Auto Apply
Abridge · SF Office · Hybrid · Posted 16 Nov 2026 🇺🇸
SQLLookerTableau+3TechnologySalary not listed - MR

Data Scientist / Advanced Manufacturing / RemoteRecently posted
Motion Recruitment Partners, LLC · United States · Remote · Posted 17 Nov 2026 🇺🇸
SQLPythonMachine LearningTechnologySalary not listed - PC

Data Scientist with Security ClearanceRecently posted
PALADIN Consulting Inc · Hill AFB, UT · On-site · Posted 16 Nov 2026 🇺🇸
DockerOracleApache Spark+16Technology$80/hr - RO

[2027] Data Scientist - PhD Early Career - SafetyRecently posted Auto Apply
Roblox · San Mateo · Hybrid · Posted 17 Nov 2026 🇺🇸
Deep LearningMachine LearningTechnology$185.9k/yr - SI

Data Scientist (Senior/Staff) - VC Backed StartupsRecently posted Auto Apply
Signalfire · Remote - No Preference · Remote · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDockerSQL+22TechnologySalary not listed - SI

Data Scientist (Senior/Staff) - VC Backed StartupsRecently posted Auto Apply
Signalfire · NYC - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDockerSQL+22TechnologySalary not listed
