New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Strange differences in results when i load saved model to eval #68

Open

illusion5556 opened this issue Oct 19, 2024 · 0 comments

illusion5556 commented Oct 19, 2024

First of all, it should be noted that I conducted the experiment on an additional dataset.

When I evaluate on dev during training, the results are P: 0.92545, R: 0.79061, F1: 0.85273.

But after training, I load the saved model, the evaluate results of dev are only P: 0.10000, R: 0.00210, F1: 0.00411.

I barely modified the original code, but I didn't solve the problem.
Looking forward to your reply.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment