Skip to content

Actions: EleutherAI/lm-evaluation-harness

Actions

Tasks Modified

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
new_tasks.yml
2,831 workflow runs
2,831 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Add --examples Argument for Fine-Grained Task Evaluation in lm-evaluation-harness. This feature is the first step towards efficient multi-prompt evaluation with PromptEval [1,2] Tasks Modified #4006: Pull request #2520 synchronize by StellaAthena
January 14, 2025 16:58 2m 2s mirianfsilva:examples-arg
mirianfsilva:examples-arg
January 14, 2025 16:58 2m 2s
add hrm8k benchmark Tasks Modified #4005: Pull request #2624 opened by bzantium
January 14, 2025 12:35 2m 10s feature/#2623
feature/#2623
January 14, 2025 12:35 2m 10s
Add MLQA Tasks Modified #4004: Pull request #2622 opened by KahnSvaer
January 13, 2025 22:37 1m 44s KahnSvaer:mlqa
KahnSvaer:mlqa
January 13, 2025 22:37 1m 44s
fix: nemo eval in containers with TransformerEngine > 1.10 won't error Tasks Modified #4003: Pull request #2621 opened by terrykong
January 10, 2025 22:38 Action required terrykong:terryk/dist-ckpt-strictness-loosen
terrykong:terryk/dist-ckpt-strictness-loosen
January 10, 2025 22:38 Action required
Added EU20 task suite Tasks Modified #4002: Pull request #2620 opened by KlaudiaTH
January 10, 2025 13:04 18m 5s OpenGPTX:eu20_tasks
OpenGPTX:eu20_tasks
January 10, 2025 13:04 18m 5s
assistant prefill Tasks Modified #4001: Pull request #2615 synchronize by baberabb
January 9, 2025 18:45 11m 11s prefix
prefix
January 9, 2025 18:45 11m 11s
assistant prefill Tasks Modified #4000: Pull request #2615 synchronize by baberabb
January 8, 2025 18:44 6m 30s prefix
prefix
January 8, 2025 18:44 6m 30s
assistant prefill Tasks Modified #3999: Pull request #2615 synchronize by baberabb
January 8, 2025 17:22 8m 50s prefix
prefix
January 8, 2025 17:22 8m 50s
assistant prefill Tasks Modified #3998: Pull request #2615 synchronize by baberabb
January 8, 2025 17:21 4m 52s prefix
prefix
January 8, 2025 17:21 4m 52s
assistant prefill Tasks Modified #3997: Pull request #2615 synchronize by baberabb
January 8, 2025 16:00 5m 7s prefix
prefix
January 8, 2025 16:00 5m 7s
assistant prefill Tasks Modified #3996: Pull request #2615 synchronize by baberabb
January 8, 2025 15:59 1m 54s prefix
prefix
January 8, 2025 15:59 1m 54s
assistant prefill Tasks Modified #3995: Pull request #2615 synchronize by baberabb
January 8, 2025 15:09 8m 49s prefix
prefix
January 8, 2025 15:09 8m 49s
assistant prefill Tasks Modified #3994: Pull request #2615 synchronize by baberabb
January 8, 2025 15:04 6m 7s prefix
prefix
January 8, 2025 15:04 6m 7s
Tasks Modified Tasks Modified #3993: by baberabb
January 7, 2025 15:42 2m 6s main
main
January 7, 2025 15:42 2m 6s
Fix the format of mgsm zh and ja. Tasks Modified #3992: Pull request #2587 synchronize by timturing
January 7, 2025 15:17 2m 19s timturing:main
timturing:main
January 7, 2025 15:17 2m 19s
assistant prefill Tasks Modified #3991: Pull request #2615 opened by baberabb
January 7, 2025 15:13 2m 30s prefix
prefix
January 7, 2025 15:13 2m 30s
Fix the format of mgsm zh and ja. Tasks Modified #3990: Pull request #2587 synchronize by timturing
January 7, 2025 14:41 1m 40s timturing:main
timturing:main
January 7, 2025 14:41 1m 40s
Tasks Modified Tasks Modified #3988: by baberabb
January 7, 2025 14:01 17s main
main
January 7, 2025 14:01 17s
Fix Zeno visualizer on tasks like GSM8k Tasks Modified #3987: Pull request #2599 synchronize by baberabb
January 7, 2025 13:56 22s pasky:zeno-gsm8k
pasky:zeno-gsm8k
January 7, 2025 13:56 22s
Fix gguf loading via Transformers (#2596) Tasks Modified #3986: Commit 16cfe46 pushed by baberabb
January 7, 2025 13:55 15s main
main
January 7, 2025 13:55 15s
add support for "adapter_id@adapter_revision" for peft Tasks Modified #3984: Pull request #2611 synchronize by antonpolishko
January 6, 2025 19:37 13s antonpolishko:main
antonpolishko:main
January 6, 2025 19:37 13s
add support for "adapter_id@adapter_revision" for peft Tasks Modified #3983: Pull request #2611 opened by antonpolishko
January 6, 2025 18:07 14s antonpolishko:main
antonpolishko:main
January 6, 2025 18:07 14s
some minor logging nits (#2609) Tasks Modified #3982: Commit 888ac29 pushed by baberabb
January 4, 2025 07:45 2m 25s main
main
January 4, 2025 07:45 2m 25s
some minor logging nits Tasks Modified #3981: Pull request #2609 opened by baberabb
January 4, 2025 07:23 1m 56s nit
nit
January 4, 2025 07:23 1m 56s
add llama3 tasks Tasks Modified #3980: Pull request #2556 synchronize by baberabb
January 2, 2025 16:34 2m 30s llama
llama
January 2, 2025 16:34 2m 30s