Model serving
SGLang
Serve language and multimodal models with optimized inference runtimes.
37.6K GitHub starsAs of Checked
Where it fits
What you can use it for
Teams running agent workloads, model services and RL rollouts.
Serve models with the performance and control your workload needs.
Before you adopt
What to check for your team
Benchmark your model and request patterns on the target hardware. Support varies by backend and accelerator.
Get help evaluating the fitLicence and scope
Apache-2.0
Applies to this repository. Dependencies, model weights, datasets and hosted services can have separate terms.
Read the upstream licenceSupport the work
Go directly to the maintainers
Use the project's contribution guidance to report issues, help with documentation or contribute code. Follow any published funding links if you want to support the maintainers financially.
Find contribution guidanceKeep exploring
