Skip to content

Add --examples Argument for Fine-Grained Task Evaluation in lm-evaluation-harness. This feature is the first step towards efficient multi-prompt evaluation with PromptEval [1,2]#2520

Open
felipemaiapolo wants to merge 10 commits intoEleutherAI:mainfrom mirianfsilva:examples-arg

Commits

Commits on Oct 28, 2024

Commits on Nov 26, 2024

Commits on Jan 14, 2025

Commits on Jan 15, 2025