Pattern
Inspect AI and inspect_evals
Provide an open framework for writing and running model and agent evaluations from composable parts (datasets, solvers or agents, tools, scorers), with sandboxed execution for agentic tasks and a maintained library of pre-built benchmarks that run against any supported model.
Classification Open evaluation framework with agent, tool-use and sandboxed evaluation, plus a shared eval library.
Full entry
The complete treatment — problem, how it works, when to use it, sources, and examples — lives in the volume below.
Browse the full pattern index or the catalog.