Model serving

BentoML

Package models and Python inference logic as deployable APIs.

8.9K GitHub starsAs of Checked

Where it fits

What you can use it for

Teams turning custom AI code into model services.

Serve models with the performance and control your workload needs.

Before you adopt

What to check for your team

Size and secure the deployment platform separately. Hosted deployment services and model licenses have separate terms.

Get help evaluating the fit

Licence and scope

Apache-2.0

Applies to this repository. Dependencies, model weights, datasets and hosted services can have separate terms.

Read the upstream licence

Support the work

Go directly to the maintainers

Use the project's contribution guidance to report issues, help with documentation or contribute code. Follow any published funding links if you want to support the maintainers financially.

Find contribution guidance

Keep exploring

Also in model serving

Back to all projects