You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hello,
I have read your paper " Meta Learning With Graph Attention Networks for Low-Data Drug Discovery". Your work inspired me a lot. So I downloaded the source code for reproduction. But the results weren't as good as they looked in your paper.
The experimental Settings are plus or minus 10, and the experimental Settings in the source code have not been changed, and the experimental Settings is shown in below
And the test result is shown in below, the roc_auc results of the tests for 3 query tasks in the tox21 dataset (the average of 20 test batches across 20 different seeds). The difference between my result and the result of your paper is too great. The roc-auc score of my result is range from 0.74 to 0.77, while the roc-auc score of your paper is larger than 0.9
Is there anything wrong with my reproduction that led to the bad result? Or is there anything I should pay attention to?
I am looking forward to your reply and I would appreciate it very much.
The text was updated successfully, but these errors were encountered:
Hello,
I have read your paper " Meta Learning With Graph Attention Networks for Low-Data Drug Discovery". Your work inspired me a lot. So I downloaded the source code for reproduction. But the results weren't as good as they looked in your paper.
The experimental Settings are plus or minus 10, and the experimental Settings in the source code have not been changed, and the experimental Settings is shown in below
And the test result is shown in below, the roc_auc results of the tests for 3 query tasks in the tox21 dataset (the average of 20 test batches across 20 different seeds). The difference between my result and the result of your paper is too great. The roc-auc score of my result is range from 0.74 to 0.77, while the roc-auc score of your paper is larger than 0.9
Is there anything wrong with my reproduction that led to the bad result? Or is there anything I should pay attention to?
I am looking forward to your reply and I would appreciate it very much.
The text was updated successfully, but these errors were encountered: