Language Model Evaluation Harness

Where it fits

What you can use it for

Researchers comparing model capabilities across repeatable tasks.

Test model outputs and agent behaviour against defined criteria.

Before you adopt

What to check for your team

Pin task definitions and model settings. Dataset licenses and benchmark contamination can affect how results may be used.

Licence and scope

MIT

Applies to this repository. Dependencies, model weights, datasets and hosted services can have separate terms.

Support the work

Go directly to the maintainers

Use the project's contribution guidance to report issues, help with documentation or contribute code. Follow any published funding links if you want to support the maintainers financially.