Skip to content

Commit

Permalink
Revert "nit"
Browse files Browse the repository at this point in the history
This reverts commit 6a97f83.
  • Loading branch information
baberabb committed Jan 8, 2025
1 parent 6a97f83 commit 7225977
Showing 1 changed file with 3 additions and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ fewshot_config:
sampler: first_n
doc_to_text: "Given the following question and four candidate answers (A, B, C and D), choose the best answer.\n{{question.strip()}}\nA. {{choices[0]}}\nB. {{choices[1]}}\nC. {{choices[2]}}\nD. {{choices[3]}}\nYour response should end with \"The best answer is [the_answer_letter]\" where the [the_answer_letter] is one of A, B, C or D."
assistant_prefix: "The best answer is"
doc_to_target: "{{target}}"
doc_to_target: "{{['A.','B.','C.','D.'][answer]}}"
num_fewshot: 5
metric_list:
- metric: exact_match
Expand All @@ -16,6 +16,8 @@ metric_list:
ignore_punctuation: true
regexes_to_ignore:
- "."
- "\\$"
- "\\.$"
generation_kwargs:
until:
- "."
Expand Down

0 comments on commit 7225977

Please sign in to comment.