LLM Jobs in New York City
195 live jobs using LLM in New York City, updated daily. Apply directly on Haystack.
Last updated 25 September 2026. Job counts refresh daily.
As of 25 September 2026, Haystack lists 195 live LLM jobs in New York City, with 22 added in the past week and typical advertised salaries of $184k to $251k. Employers hiring right now include Anthropic, Kepler Ai and Snorkel AI. 3% of these roles are remote friendly.
Top companies hiring
plus 92 more companies hiring in this category
- GT
Manager, GTM Engineering
NewGrow Therapy
New York City馃嚭馃嚫$140k - $175k/yrHybrid20 hours agoLinearCRMData Pipeline+9Engineering - DA
Staff Software Engineer, Agent Quality
NewDatabricks
New York City馃嚭馃嚫$200k/yrHybrid22 hours agoComplianceDatabricksLLM+2Technology - AC
Knowledge Engineer / Semantic Expert for AI Associate Director
NewAccenture
New York City, New York馃嚭馃嚫$132.5k - $338.3k/yrOn-site11 hours agoGCPNeo4jAWS+12 - JM
Applied AI ML Lead - AI Agents & Agentic Systems (Corporate Sector)
NewJ.P. Morgan
New York City, New York馃嚭馃嚫On-site11 hours agoAWSMLflowMachine Learning+10 - WR
Staff security engineer, application security
NewWriter
New York City馃嚭馃嚫HybridYesterdayGenerative AIJavaJavaScript+4Technology - VE
Revenue Operations Analyst
NewVersemedical
New York City馃嚭馃嚫HybridYesterdaySQLSalesforceCRM+10Operations & Project Management - TW
Tax Manager
NewTwitch
New York City馃嚭馃嚫HybridYesterdayCPAComplianceLLM+1Finance - OP
Deployment Lead, Financial Services- NYC
NewOpenai
New York City馃嚭馃嚫Hybrid2 days agoSketchBackground ChecksCompliance+2Finance - LE
Senior IT Auditor
NewLegora
New York City馃嚭馃嚫On-site2 days agoGCPSQLAWS+13 - LE
Internal Audit Manager
NewLegora
New York City馃嚭馃嚫On-site2 days agoSQLSalesforceTableau+10FinanceGet new LLM jobs in New York City in your inbox
Daily digest of matching roles. Unsubscribe anytime.
- BR
Platform Engineer
NewBrellium
New York City馃嚭馃嚫Hybrid2 days agoAWSSOC 2SSO+7Technology - AM
Sales Engineer [NYC]
NewAmigo
New York City馃嚭馃嚫On-site2 days agoGCPAWSSOC 2+7Engineering - SQ
Senior Lead, AI Pricing & Margin Strategy
NewSquarespace
New York City馃嚭馃嚫$125.8k - $170.2k/yrHybrid2 days agoSQLMarket ResearchConcrete+3 - SC
Revenue Operations Manager
Sigma Computing
New York City馃嚭馃嚫$150k - $210k/yrHybrid3 days agoSQLSalesforceDatabricks+7Operations & Project Management - CO
Senior Full-Stack Product Engineer
Conveo.ai
New York City, New York馃嚭馃嚫$180k - $240k/yrHybrid3 days agoGCPNode.jsAWS+6 - MO
Head of Data / Staff Data Engineer
Manifest Os
New York City馃嚭馃嚫On-site4 days agoSQLSnowflakeBigQuery+4Technology - TR
Staff Product Manager (AI Agents)
Traba
New York City馃嚭馃嚫$180k - $210k/yrHybrid4 days agoLLMOperations & Project Management - TR
Senior Product Manager (AI Agents)
Traba
New York City馃嚭馃嚫Hybrid4 days agoLLMOperations & Project Management - TR
Product Manager (AI Agents)
Traba
New York City馃嚭馃嚫Hybrid4 days agoLLMOperations & Project Management - RA
AI Strategist
Raylu Ai
New York City馃嚭馃嚫On-site4 days agoAccount ManagementCustomer SuccessLLM+3 - BL
AI Platform & Application Engineer - Vice President
BlackRock
New York City, New York馃嚭馃嚫$162k - $215k/yrHybrid6 days agoAgileJavaLLM+1Technology - GR
Sr. Software Engineer - Platform Engineering
Grubhub
New York City, New York馃嚭馃嚫$176k - $191k/yrHybrid6 days agoJavaLESSLLM+1Technology - BL
AI and Security Architect, Director
BlackRock
New York City, New York馃嚭馃嚫$215k - $275k/yrHybrid1 week agoGCPAWSAzure+1Technology - BH
Member of Technical Staff
Blossom Health
New York City馃嚭馃嚫On-site1 week agoLLMMental HealthPython+1 - BR
Director, Applied AI Architects
Braze
New York City馃嚭馃嚫$193k/yrHybrid3 days agoSalesforceSnowflakeConcrete+9 - KA
Founding Talent
Kepler Ai
New York City馃嚭馃嚫On-site1 week agoRustLLMSourcing+1 - GR
Full Stack Software Engineering Intern
Gecko Robotics
New York City馃嚭馃嚫On-site1 week agoDockerGCPRobotics+8Technology - GR
AI/Machine Learning Engineering Intern
Gecko Robotics
New York City馃嚭馃嚫On-site1 week agoDockerGCPSQL+11Technology - BH
Applied AI Software Engineer
Blossom Health
New York City馃嚭馃嚫On-site1 week agoLLMPythonTypeScriptTechnology - BH
Software Engineer
Blossom Health
New York City馃嚭馃嚫On-site1 week agoLLMPythonTypeScriptTechnology
Frequently asked questions
How many LLM jobs in New York City are available?
Haystack currently lists 195 live LLM jobs in New York City, with 22 added in the past week. Numbers refresh daily.
What do LLM jobs in New York City pay?
Advertised salaries typically range from $184k to $251k per year, based on 86 live postings with advertised salaries.
Which companies are hiring for LLM jobs in New York City?
Anthropic, Kepler Ai, Snorkel AI, Traba, Garner Health are actively hiring right now, alongside 93 other employers.
Are there remote LLM jobs in New York City?
Yes. 6 of the current listings are remote friendly. Browse the remote-only view.