Model serving

Ollama

Download and run models locally, then connect them to applications and coding agents.

184.1K GitHub starsAs of Checked

Where it fits

What you can use it for

Developers starting with local model inference.

Serve models with the performance and control your workload needs.

Before you adopt

What to check for your team

Check each model's license and memory needs. Local execution and optional cloud services have different data boundaries.

Get help evaluating the fit

Licence and scope

MIT

Applies to this repository. Dependencies, model weights, datasets and hosted services can have separate terms.

Read the upstream licence

Support the work

Go directly to the maintainers

Use the project's contribution guidance to report issues, help with documentation or contribute code. Follow any published funding links if you want to support the maintainers financially.

Find contribution guidance

Keep exploring

Also in model serving

Back to all projects