-
Notifications
You must be signed in to change notification settings - Fork 71
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ns-train in2n error; loaded pretrained model results bad. #92
Comments
So the issue here is that once you train nerfacto and then render it after loading it, the results look worse here? |
Yes. |
That is super odd. Is this after some iterations of in2n have been run or no? |
Yes. This is the result from right after starting. |
have u tried it after letting it train for some time? not sure why this would be the case, but maybe the first few iterations of in2n updates kinda mess things up. You can also launch with pausing the training or in inference mode so that you can see before any in2n steps are done |
I'll try pausing the initial iterations of training and use it later. Thank you for answering! |
It seems that the Instruct-nerf2nerf pipeline is not properly loading the pre-trained nerfacto model.
The first image is the result of ns-viewer with pre-trained nerfacto model.
The second image is the rendered image before training “ns-train in2n” with pre-trained nerfacto model.
A few weeks ago, I confirmed that it was working properly with same script file, but after downloading the repo again and checking, I cannot see the same results as before.
When looking at the results of the viewer(upper image), it seems that nerfacto has been trained well, but when looking at the initial nerf rendered image of in2n(below image), it seems that the pre-trained nerfacto model is not being properly loaded.
Is there anything missing or something I should check?
The setup follows the Torch 2.1.2 with CUDA 11.8 settings from https://docs.nerf.studio/quickstart/installation.html. After installing nerfstudio, I downloaded the instruct-nerf2nerf repo again to ensure that in2n could function properly.\
The text was updated successfully, but these errors were encountered: