Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The Evaluation Metrics of Radarnet and the Learning Rate Adjustment Strategy of Fusionnet #31

Open
ZZX10082 opened this issue Oct 3, 2024 · 2 comments

Comments

@ZZX10082
Copy link

ZZX10082 commented Oct 3, 2024

Hello, thank you very much for your excellent work. During the process of reproducing your paper, I trained for 200 epochs and obtained a radar net weight. Its RMSE, MAE, and other indicators are similar to the evaluation results of the weight file you provided, but the output and Intersection are relatively low. What role do these two indicators play in judging network performance, and are higher indicators better? How should I adjust my learning strategy
myradarnet
radarnet
if I want to obtain a result that approximates the weights you provided
@thecyclone

@ZZX10082
Copy link
Author

ZZX10082 commented Oct 3, 2024

For the training of fusionnet, in the code you provided, it is trained using learning_rates 1e-3 and learning_stchedule 450, while the learning strategy mentioned in the paper is: "with a learning schedule 1e-3 for 400 epochs, then reduced to 5e-4 for another 50 epochs, and finally reduced 1e-4 for further fine-tuning After 450 rounds of training without changing the learning rate (i.e. without making any changes to the code in GitHub), I obtained the best results at step=695000. The network performance obtained is significantly different from the reference indicators in the paper. Do I need to modify the parameters according to the paper to adjust the learning strategy? And what you mentioned in your paper, "Training takes ≈ 36 hours for 75 epochs on a NVIDIA RTX A5000 GPU." "Training takes ≈ 36 hours for 200 epochs on a NVIDIA RTX A5000," is this just a reference for training time, rather than referring to the fact that Radarnet and Fusionnet only need to be trained for 75 and 200 epochs respectively
myfusionnet
Uploading fusionnet.png…

@ZZX10082
Copy link
Author

ZZX10082 commented Oct 13, 2024

I have reduced my learning rate and continued training, but still cannot achieve satisfactory results. Can you help me? @thecyclone
f94b3a9da0f30c7ae4d822955d518264

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant