Evaluation

OpenCompass

Compare language and vision-language models across capability benchmarks.

7.5K GitHub starsAs of Checked

Where it fits

What you can use it for

Teams running broad model evaluation suites.

Test model outputs and agent behaviour against defined criteria.

Before you adopt

What to check for your team

Select tasks that match the intended use. Pin datasets and prompts, and review provider costs before a large run.

Get help evaluating the fit

Licence and scope

Apache-2.0

Applies to this repository. Dependencies, model weights, datasets and hosted services can have separate terms.

Read the upstream licence

Support the work

Go directly to the maintainers

Use the project's contribution guidance to report issues, help with documentation or contribute code. Follow any published funding links if you want to support the maintainers financially.

Find contribution guidance

Keep exploring

Also in evaluation

Back to all projects