Skip to content

Actions: EleutherAI/lm-evaluation-harness

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
3,135 workflow run results
3,135 workflow run results

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Add various social bias tasks
Tasks Modified #2465: Pull request #1185 synchronize by oskarvanderwal
May 24, 2024 15:31 7m 16s winogender
May 24, 2024 15:31 7m 16s
add mmlu tasks from pile-t5
Unit Tests #2438: Pull request #1710 synchronize by haileyschoelkopf
May 24, 2024 15:31 9m 34s pile-t5
May 24, 2024 15:31 9m 34s
Add various social bias tasks
Unit Tests #2436: Pull request #1185 synchronize by oskarvanderwal
May 24, 2024 15:30 4m 32s winogender
May 24, 2024 15:30 4m 32s
Add various social bias tasks
Tasks Modified #2464: Pull request #1185 synchronize by oskarvanderwal
May 24, 2024 15:30 6m 43s winogender
May 24, 2024 15:30 6m 43s
add mmlu tasks from pile-t5
Unit Tests #2435: Pull request #1710 synchronize by haileyschoelkopf
May 24, 2024 15:30 5m 41s pile-t5
May 24, 2024 15:30 5m 41s
add mmlu tasks from pile-t5
Tasks Modified #2463: Pull request #1710 synchronize by haileyschoelkopf
May 24, 2024 15:30 2m 30s pile-t5
May 24, 2024 15:30 2m 30s
add mmlu tasks from pile-t5
Unit Tests #2434: Pull request #1710 synchronize by haileyschoelkopf
May 24, 2024 15:30 5m 14s pile-t5
May 24, 2024 15:30 5m 14s
add mmlu tasks from pile-t5
Tasks Modified #2462: Pull request #1710 synchronize by haileyschoelkopf
May 24, 2024 15:30 2m 42s pile-t5
May 24, 2024 15:30 2m 42s
add mmlu tasks from pile-t5
Unit Tests #2433: Pull request #1710 synchronize by haileyschoelkopf
May 24, 2024 15:29 5m 6s pile-t5
May 24, 2024 15:29 5m 6s
add mmlu tasks from pile-t5
Tasks Modified #2461: Pull request #1710 synchronize by haileyschoelkopf
May 24, 2024 15:29 4m 21s pile-t5
May 24, 2024 15:29 4m 21s
Fix for bootstrap_iters = 0 case (#1715)
Tasks Modified #2460: Pull request #1789 synchronize by haileyschoelkopf
May 24, 2024 15:27 1m 43s 1715-nostderr-typerror
May 24, 2024 15:27 1m 43s
Fix for bootstrap_iters = 0 case (#1715)
Unit Tests #2432: Pull request #1789 synchronize by haileyschoelkopf
May 24, 2024 15:27 5m 13s 1715-nostderr-typerror
May 24, 2024 15:27 5m 13s
Fix batch_size=auto for HF Seq2Seq models (#1765) (#1790)
Unit Tests #2431: Commit 5f3a662 pushed by haileyschoelkopf
May 24, 2024 15:24 6m 41s main
May 24, 2024 15:24 6m 41s
Fix batch_size=auto for HF Seq2Seq models (#1765) (#1790)
Tasks Modified #2459: Commit 5f3a662 pushed by haileyschoelkopf
May 24, 2024 15:24 15s main
May 24, 2024 15:24 15s
[HFLM]Use Accelerate's API to reduce hard-coded CUDA code (#1880)
Tasks Modified #2458: Commit c4c1591 pushed by haileyschoelkopf
May 24, 2024 15:12 11s main
May 24, 2024 15:12 11s
[HFLM]Use Accelerate's API to reduce hard-coded CUDA code (#1880)
Unit Tests #2430: Commit c4c1591 pushed by haileyschoelkopf
May 24, 2024 15:12 5m 15s main
May 24, 2024 15:12 5m 15s
Fix for bootstrap_iters = 0 case (#1715)
Tasks Modified #2457: Pull request #1789 synchronize by haileyschoelkopf
May 24, 2024 15:10 1m 41s 1715-nostderr-typerror
May 24, 2024 15:10 1m 41s
Fix for bootstrap_iters = 0 case (#1715)
Unit Tests #2429: Pull request #1789 synchronize by haileyschoelkopf
May 24, 2024 15:10 6m 13s 1715-nostderr-typerror
May 24, 2024 15:10 6m 13s
Fix batch_size=auto for HF Seq2Seq models (#1765)
Tasks Modified #2456: Pull request #1790 synchronize by haileyschoelkopf
May 24, 2024 15:06 10s 1765-seq2seq-bs-auto
May 24, 2024 15:06 10s
Fix batch_size=auto for HF Seq2Seq models (#1765)
Unit Tests #2428: Pull request #1790 synchronize by haileyschoelkopf
May 24, 2024 15:06 5m 7s 1765-seq2seq-bs-auto
May 24, 2024 15:06 5m 7s
Factor out LM-specific tests
Tasks Modified #2455: Pull request #1859 synchronize by haileyschoelkopf
May 24, 2024 14:58 14s fix-neuralmagic-tests
May 24, 2024 14:58 14s
Factor out LM-specific tests
Unit Tests #2427: Pull request #1859 synchronize by haileyschoelkopf
May 24, 2024 14:58 4m 53s fix-neuralmagic-tests
May 24, 2024 14:58 4m 53s
Add LegalBench tasks
Tasks Modified #2454: Pull request #1878 synchronize by zafstojano
May 24, 2024 14:35 2m 21s zafstojano:add-legalbench-tasks
May 24, 2024 14:35 2m 21s
Add LegalBench tasks
Unit Tests #2426: Pull request #1878 synchronize by zafstojano
May 24, 2024 14:35 5m 39s zafstojano:add-legalbench-tasks
May 24, 2024 14:35 5m 39s
Fix outdated links to the latest links in docs (#1876)
Tasks Modified #2451: Commit b5afe22 pushed by lintangsutawika
May 24, 2024 02:51 17s main
May 24, 2024 02:51 17s