From 410b3dd0c82a787e59245a0b17e2216c6159acee Mon Sep 17 00:00:00 2001 From: qbc Date: Fri, 22 Dec 2023 14:13:04 +0800 Subject: [PATCH 1/2] fix typo in readme for helm --- federatedscope/llm/eval/eval_for_helm/README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/federatedscope/llm/eval/eval_for_helm/README.md b/federatedscope/llm/eval/eval_for_helm/README.md index 95f0dd181..ff469552f 100644 --- a/federatedscope/llm/eval/eval_for_helm/README.md +++ b/federatedscope/llm/eval/eval_for_helm/README.md @@ -90,7 +90,7 @@ * In `~/helm_fs/src/crfm-helm/evaluation/setup_server.sh`, set * `SUITE_NAME=${SUITE_NAME}` * `PATH_HELM=~/helm_fs/src/crfm-helm` - * `PATH_HELM=~/helm_fs/src/crfm-helm` + * `PATH_WORKDIR=~/helm_fs/src/crfm-helm` * `root/miniconda3/bin/python -> ${which python}` * `bash evaluation/setup_server.sh -n ${SUITE_NAME} -p ${PORT}` * Remark: Actually, it will show the result of the last task. If you want to see the result of another task, say, the suite name is result_of_exp1, add `?suite=result_of_exp1`after the port address. From c20e6637908c586a9bb9b3fd9262c330f8e41cb7 Mon Sep 17 00:00:00 2001 From: qbc Date: Mon, 25 Dec 2023 17:56:51 +0800 Subject: [PATCH 2/2] minor changes --- federatedscope/llm/eval/eval_for_helm/README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/federatedscope/llm/eval/eval_for_helm/README.md b/federatedscope/llm/eval/eval_for_helm/README.md index ff469552f..7143fc92b 100644 --- a/federatedscope/llm/eval/eval_for_helm/README.md +++ b/federatedscope/llm/eval/eval_for_helm/README.md @@ -87,7 +87,7 @@ * Start to evaluate * `helm-run --conf-paths federatedscope/llm/eval/eval_for_helm/run_specs.conf --enable-local-huggingface-model decapoda-research/llama-7b-hf --suite ${SUITE_NAME} -m 100 --local -n 1 --skip-completed-runs --local-path xxx` * Launch webserver to view results - * In `~/helm_fs/src/crfm-helm/evaluation/setup_server.sh`, set + * In `~/helm_fs/src/crfm-helm/evaluation/setup_server.sh`, set * `SUITE_NAME=${SUITE_NAME}` * `PATH_HELM=~/helm_fs/src/crfm-helm` * `PATH_WORKDIR=~/helm_fs/src/crfm-helm`