Why this role stands out
You'll have the opportunity to significantly impact how millions of developers interact with open models by shaping core product experiences and building essential integrations. This role is ideal for a product-minded engineer who thrives in a fast-paced, collaborative environment and enjoys solving complex technical challenges that delight users. Apply to join a talented team at a rapidly growing, well-backed company at the forefront of the AI ecosystem.
Quick overview
Job description
Ollama is the most popular way for developers to access open models. What started as an open-source, local-first runtime is now the largest developer network in the open-model ecosystem, with 8.9 million monthly active developers and more than 67,000 community-built integrations. We're backed by Y Combinator, Benchmark, 8VC, and Theory Ventures.
Our team is small and talent-dense. We're flat, low-ego, and fast-moving. We like people who think from first principles, have strong product instincts, and care deeply about making software feel simple and delightful.
About the role
You'll shape how people use Ollama across the desktop app, CLI, and tools they already use. A major part of the role is making open models work well with existing agent harnesses, coding tools, IDEs, and desktop applications.
This is a product engineering role with broad ownership. You'll design interfaces, build native and backend systems, create integrations, and test complete user journeys across local and cloud models.
What you'll do
Build and refine Ollama's desktop app, CLI, onboarding, and more.
Make agents and developer tools easy to connect to Ollama.
Build first-class integrations while developing reusable systems that let others create and maintain their own.
Ensure local and cloud models work reliably across different tools and agent harnesses.
Test integrations through real workflows and turn recurring failures into durable compatibility improvements.
Work across native applications, Go services and APIs, and web product surfaces.
Partner with model and inference engineers to ship new models with appropriate capabilities, defaults, and integration support.
You may be a fit if
You've built a thoughtful developer product that real people use.
You combine strong engineering fundamentals with product judgment and visual attention.
You're comfortable owning ambiguous work from exploration through implementation and polish.
You enjoy debugging behavior across processes, configuration files, APIs, native applications, and third-party tools.
You can simplify complex systems without hiding important behavior from users.
You care about state preservation, recovery, compatibility, and the details that make integrations trustworthy.
You're comfortable working across several parts of the stack. Experience with Go, TypeScript, React, or similar technologies is useful.
You test your work hands-on and recognize when technically correct behavior still produces a poor experience.
You make good decisions in gray areas by weighing user needs, technical constraints, data, and product taste.
You use agents to help you prototype, iterate, and ship to production fast.
Partner with model and inference engineers to ship new models with appropriate capabilities, defaults, and integration support.
Nice to have
You've built an agent, contributed to an agent harness, or modified one enough to understand how models, tools, context, permissions, and configuration interact.
You have experience building developer tools, native desktop applications, IDE extensions, or integrations with third-party software.
You've worked with local inference, hosted models, or products that must behave consistently across both.
You've built something with Ollama!
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- SU

Software EngineerRecently posted Auto Apply
Sustainment · Austin · Hybrid · Posted 13 Nov 2026 🇺🇸
DockerGitAWS+11TechnologySalary not listed - SP

Software Engineer, High Performance ComputingRecently posted Auto Apply
SpaceX · Hawthorne · Hybrid · Posted 13 Nov 2026 🇺🇸
C++PythonMachine Learning+3Technology$125k - $150k/yr - SS

Intern, SSD Firmware DevelopmentRecently posted Auto Apply
Samsung Semiconductor · San Jose · Hybrid · Posted 13 Nov 2026 🇺🇸
Microsoft ExcelScrumC+++2$28 - $68/hr - SA

Sr Software Engineer I/II, Operational AIRecently posted Auto Apply
Samsara · Remote - US · Remote · Posted 14 Nov 2026 🇺🇸
Computer VisionCustomer SuccessGreenhouse+4Technology$154.7k/yr - AR

Software Engineer III, Software Services (Applications)Recently posted Auto Apply
Agility Robotics · Hybrid- Any Office (Fremont · Hybrid · Posted 13 Nov 2026 🇺🇸
DockerDynamoDBRust+14Technology$144k/yr - LA

Software Engineer - Data Center ToolingRecently posted Auto Apply
Lambda · San Francisco Office (Fremont St) · Hybrid · Posted 14 Nov 2026 🇺🇸
ETLInventory ManagementPython+5TechnologySalary not listed - LA

Senior Software EngineerRecently posted Auto Apply
Lambda · San Francisco Office (Fremont St) · Hybrid · Posted 13 Nov 2026 🇺🇸
AngularCypressJest+3TechnologySalary not listed - AN

Senior Software Engineer, Funds Auto Apply
Angellist · San Francisco · Hybrid 🇺🇸
MySQLTechnology$200k/yr - OV

Forward Deployed EngineerRecently posted Auto Apply
Overjet · San Mateo · Hybrid · Posted 14 Nov 2026 🇺🇸
EngineeringSalary not listed - TT
Lead Software Engineer, PlatformRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 14 Nov 2026 🇺🇸
RustPythonScheduling+1Technology$220k - $320k/yr - TT
Software Engineer, MarketplaceRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 14 Nov 2026 🇺🇸
OnboardingKafkaOutreach+5Technology$250k - $300k/yr - PC
Survey and Research Programmer Auto Apply
ProSidian Consulting, LLC · Charlotte, NC · On-site 🇺🇸
Microsoft ExcelMicrosoft OfficeMicrosoft Word+6Salary not listed
