New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

做全词遮蔽的比例设置？ #76

Open

surimj opened this issue Sep 26, 2020 · 1 comment

surimj commented Sep 26, 2020

您好，请问关于“注：在我们的实验中使用15%的比例做全词遮蔽，模型学习难度大、收敛困难，所以我们用了10%的比例”，全词mask的比例15%的设置，在create_pretrainig_data.py中有体现吗？我没有找到这个比例是在哪里实现控制的？

Owner

brightmart commented Oct 2, 2020

比例通过命令的超参数传入的

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment