Quick overview
SeniorityMid Senior
Employment typeFull Time
Work modeHybrid
LocationNew York, United States
LLMPythonMachine Learning
Job description
Join Cantor Fitzgerald Technology Markets LLC as a Machine Learning Engineer focused on building AI‑driven solutions for a high‑volume financial services business. You will work closely with product, engineering, and business teams to create, test, and operationalize large language model (LLM) applications, ensuring they meet performance, reliability, and responsible‑AI standards.
- Design and implement LLM‑driven features in production systems.
- Build and maintain data pipelines for both structured and unstructured data.
- Write clean, testable Python code and maintain reusable libraries.
- Develop prompts, tool‑calling workflows, and retrieval pipelines.
- Create evaluation suites, define success metrics, and analyze failures.
- Diagnose and mitigate hallucination, latency, and cost issues.
- Collaborate with product, engineering, and business stakeholders.
- Implement monitoring, logging, and alerting for AI services.
- Contribute to responsible‑AI guardrails and human‑in‑the‑loop processes.
- Document designs, experiments, and findings for internal knowledge sharing.
- Bachelor’s degree in computer science, machine learning, mathematics, physics, statistics, econometrics, or equivalent practical experience.
- Experience contributing to production or production‑like software through work, internships, research, open source, or substantial personal projects.
- Strong programming ability in Python with clear, tested, and maintainable code.
- Experience with web services, data integrations, testing, logging, and basic monitoring across diverse data types.
- Hands‑on experience building with LLM tools or frameworks (prompting, structured outputs, tool‑calling, retrieval, multi‑step workflows) and awareness of common failure modes.
- Experience evaluating LLM‑powered applications: building test sets, reviewing failures, defining metrics, and iterating on prompts or retrieval.
- Solid grounding in machine learning, statistics, and experimental design with ability to interpret technical papers and documentation.
- Strong communication skills and comfort working with product, engineering, and business partners.
- Interest in applying AI responsibly in financial services, including privacy, security, human review, and appropriate automation.
- Familiarity with cloud deployment, containers, and modern release pipelines.
$140,000 - $160,000
Similar jobs
- VI

WordPress DeveloperRecently posted Auto Apply
Virtasant · Austin · Remote 🇺🇸
RecruitingMySQLPHP+11TechnologySalary not listed - BU
Cybersecurity Engineering Residency ProgramRecently posted Auto Apply
Bluestaq US External · Colorado Springs · Hybrid 🇺🇸
AWSSplunkTCP/IP+6TechnologySalary not listed - RI

Sr. Software Engineer - Infotainment Software (Apple CarPlay)Recently posted Auto Apply
Rivianvw.tech · Palo Alto · Hybrid 🇺🇸
RecruitingGitBackground Checks+10TechnologySalary not listed - RI

Senior Software EngineerRecently posted Auto Apply
Rivianvw.tech · Palo Alto · On-site 🇺🇸
RustShellGit+8TechnologySalary not listed - RE
Staff Developer Relations EngineerRecently posted Auto Apply
Render · Remote: United States · Remote 🇺🇸
DockerGitGDPR+5TechnologySalary not listed - RR

Sr. Simulation Software EngineerRecently posted Auto Apply
Reliable Robotics · Mountain View · Hybrid 🇺🇸
RoboticsComplianceC+++1TechnologySalary not listed - QU

Senior/Staff Software Engineer, Customer Integrations — PCB/CADRecently posted Auto Apply
Quilter · Los Angeles · Remote 🇺🇸
CADAltiumPCB Design+2TechnologySalary not listed - ZO

Test Infrastructure EngineerRecently posted Auto Apply
Zoox · Foster City · On-site 🇺🇸
DockerGitAWS+15Technology$183k - $220k/yr - ZO

Staff Systems Engineer, Simulation Systems Verification and Validation LeadRecently posted Auto Apply
Zoox · Foster City · Hybrid 🇺🇸
SQLRoboticsADAS+3Technology$208k - $287k/yr - PE

IT EngineerRecently posted Auto Apply
Perplexity · San Francisco · Hybrid 🇺🇸
Google WorkspaceBashHelp Desk+3TechnologySalary not listed - TE

Cybersecurity Internship Summer 2027 - ThreatRecently posted Auto Apply
Tevora · Irvine · On-site 🇺🇸
Microsoft ExcelComplianceDNS+3Technology$27/hr - TE

Cybersecurity Internship Summer 2027 - SolutionsRecently posted Auto Apply
Tevora · Irvine · On-site 🇺🇸
Microsoft ExcelComplianceDNS+3Technology$27/hr