Code

add llama3 tasks#2556

Code

Open

baberabb wants to merge 25 commits intomainEleutherAI/lm-evaluation-harness:mainfrom llamaEleutherAI/lm-evaluation-harness:llamaCopy head branch name to clipboard

+1,079

Commits

Commits on Dec 10, 2024

• add mgsm

  baberabb

  committed
  f44f2c5

  Copy full SHA for f44f2c5

• add arc_challenge

  baberabb

  committed
  29ac037

  Copy full SHA for 29ac037

• nit

  baberabb

  committed
  3163140

  Copy full SHA for 3163140

• test arc_challenge

  baberabb

  committed
  6d0c60d

  Copy full SHA for 6d0c60d

• use allenai/ai2_arc

  baberabb

  committed
  6a72f62

  Copy full SHA for 6a72f62

Commits on Jan 2, 2025

• add all the different translations of Answer to regex

  baberabb

  committed
  668603f

  Copy full SHA for 668603f

• add mgsm

  baberabb

  committed
  b0108cf

  Copy full SHA for b0108cf

• add mgsm

  baberabb

  committed
  6884c5a

  Copy full SHA for 6884c5a

• add mgsm

  baberabb

  committed
  2de3ffd

  Copy full SHA for 2de3ffd

• nit

  baberabb

  committed
  40027bc

  Copy full SHA for 40027bc

• use chinese colon

  baberabb

  committed
  0c50bfa

  Copy full SHA for 0c50bfa

• nit

  baberabb

  committed
  8adf999

  Copy full SHA for 8adf999

• nit

  baberabb

  committed
  06db8b9

  Copy full SHA for 06db8b9

• nit

  baberabb

  committed
  523243d

  Copy full SHA for 523243d

• nit

  baberabb

  committed
  da92dc8

  Copy full SHA for da92dc8

Commits on Jan 21, 2025

• add llama_math

  baberabb

  committed
  748eb47

  Copy full SHA for 748eb47

• Merge branch 'main' into llama

  Show description for bc4b922
  baberabb

  committed
  bc4b922

  Copy full SHA for bc4b922

• nit

  baberabb

  committed
  2793ceb

  Copy full SHA for 2793ceb

• add math500

  baberabb

  committed
  4df2c7b

  Copy full SHA for 4df2c7b

• nit

  baberabb

  committed
  b465d53

  Copy full SHA for b465d53

• nit

  baberabb

  committed
  f198094

  Copy full SHA for f198094

• allow repeats

  baberabb

  committed
  80b2244

  Copy full SHA for 80b2244

• add math500 pass@1

  baberabb

  committed
  6bc8b8c

  Copy full SHA for 6bc8b8c

• fix

  baberabb

  committed
  1f63b3d

  Copy full SHA for 1f63b3d

Commits on Jan 22, 2025

• fix

  baberabb

  committed
  37eb9c9

  Copy full SHA for 37eb9c9