A agentindex
Tools · Inference engine

Ollama

Run large language models locally with one command.

Visit site GitHub
Open source Self-hostable free
Inference engine
In these stacks
Write code with AIBuild my own agent
LicenseMIT
PriceFree
UsageNo model cost
Model supportlocal, multi
Languagesgo
GitHub stars175.4k
Last activity2026-07-04
Verified2026-06-27
Verified byseed

A local runtime that bundles model weights and an OpenAI-compatible server so you can run and chat with open models on a laptop or server.

Strengths

  • Easiest path to running models locally
  • Huge model library and OpenAI-compatible API

Tradeoffs

  • Less throughput than dedicated serving engines
  • Local hardware limits model size

Compare with