Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Create A Good Pull Request
新增大模型
pytorch
中的MT5
~需要在
dataset
的PyTorch/dataset/
中新建mt5_small
文件夹,其目录结构如下:其中,
checkpoints
目录放置模型文件:config.json
pytorch_model.bin
模型文件需要从 https://hf-mirror.com/google/mt5-small/tree/main 中下载 ~
另外,输入输出文件:
pytorch_input.pkl
pytorch_output.pkl
output 是通过 pytorch 运行获得,input 参考
transformers
的例子:转换后的结果 ~
可从如下共享网盘中获取:https://pan.baidu.com/s/1PhxvkbYotzbyzxutd5nYHQ ~ 提取码请私信获取 ~
模型文件上传至服务器后,可重新运行 CI ~
以下为本地验证的结果:
> sh run_convert.sh
> sh run_benchmark.sh
> python deploy_infer.py
@luotao1