Evaluation

DeepEval

Write tests for LLM applications, agent steps and complete agent trajectories.

19K GitHub starsAs of Checked

Where it fits

What you can use it for

Developers adding AI quality checks to test workflows.

Test model outputs and agent behaviour against defined criteria.

Before you adopt

What to check for your team

Calibrate judge models with reviewed examples. Hosted Confident AI features and API calls have separate terms and costs.

Get help evaluating the fit

Licence and scope

Apache-2.0

Applies to this repository. Dependencies, model weights, datasets and hosted services can have separate terms.

Read the upstream licence

Support the work

Go directly to the maintainers

Use the project's contribution guidance to report issues, help with documentation or contribute code. Follow any published funding links if you want to support the maintainers financially.

Find contribution guidance

Keep exploring

Also in evaluation

Back to all projects