Pattern

Agent task benchmarks (tau-bench, Terminal-Bench, AgentDojo)

Evaluate an agent by giving it a realistic task in a simulated environment with tools, then checking the state the environment ends in and how consistently the agent succeeds across repeated trials, rather than grading a single text answer.

Classification Outcome-based agent benchmarks that check environment state and repeated-trial reliability.