Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

对话模块的实验结果优于原论文的结果 #15

Open
C-hase opened this issue Nov 16, 2022 · 6 comments
Open

对话模块的实验结果优于原论文的结果 #15

C-hase opened this issue Nov 16, 2022 · 6 comments

Comments

@C-hase
Copy link

C-hase commented Nov 16, 2022

{'ppl': 0, 'dist1': 0.1659376322844645, 'dist2': 0.4420770424721321, 'dist3': 0.6074502610413433, 'dist4': 0.6902779737547622, 'bleu1': 0.10501320414984876, 'bleu2': 0.029334851364869994, 'bleu3': 0.019595318520804313, 'bleu4': 0.014439181487995948, 'count': 7087}
没有对源码做任何处理,这个是对话模块的实验结果,比论文结果高出了将近20%,有人跑出来也是这样吗?

@LoveAnneke
Copy link

{'ppl': 0, 'dist1': 0.1659376322844645, 'dist2': 0.4420770424721321, 'dist3': 0.6074502610413433, 'dist4': 0.6902779737547622, 'bleu1': 0.10501320414984876, 'bleu2': 0.029334851364869994, 'bleu3': 0.019595318520804313, 'bleu4': 0.014439181487995948, 'count': 7087} 没有对源码做任何处理,这个是对话模块的实验结果,比论文结果高出了将近20%,有人跑出来也是这样吗?

你好,请问下第二步骤你跑了大概多久?我可以加你一个联系方式吗?我想问一些问题

@C-hase
Copy link
Author

C-hase commented Nov 18, 2022

{'ppl': 0, 'dist1': 0.1659376322844645, 'dist2': 0.4420770424721321, 'dist3': 0.6074502610413433, 'dist4': 0.6902779737547622, 'bleu1': 0.10501320414984876, 'bleu2': 0.029334851364869994, 'bleu3': 0.019595318520804313, 'bleu4': 0.014439181487995948, 'count': 7087} 没有对源码做任何处理,这个是对话模块的实验结果,比论文结果高出了将近20%,有人跑出来也是这样吗?

你好,请问下第二步骤你跑了大概多久?我可以加你一个联系方式吗?我想问一些问题

可以的,我在云服务器上跑,跑了15个小时,qq994953491

@DragonBoard
Copy link

{'ppl': 0, 'dist1': 0.1659376322844645, 'dist2': 0.4420770424721321, 'dist3': 0.6074502610413433, 'dist4': 0.6902779737547622, 'bleu1': 0.10501320414984876, 'bleu2': 0.029334851364869994, 'bleu3': 0.019595318520804313, 'bleu4': 0.014439181487995948, 'count': 7087} 没有对源码做任何处理,这个是对话模块的实验结果,比论文结果高出了将近20%,有人跑出来也是这样吗?

您好,请问一下您用的什么环境?

@Yang-bug-star
Copy link

您好,我也发现了确实是优于原论文结果,代码实现应该是评估sentence level上的dist,但论文中的应该是word level的,但我不知道具体是怎么计算才能得到原论文结果,请问您解决了吗?

@LQlq123
Copy link

LQlq123 commented Apr 11, 2023

想请教一下,冷启动设置具体是在哪里,并没有找到,感谢解答

@DragonBoard
Copy link

DragonBoard commented Apr 11, 2023 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants