New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Loading pretrained EVA-02 weights using RoPE at different resolution #167

Open

CardenB opened this issue Oct 7, 2024 · 0 comments

CardenB commented Oct 7, 2024

Hi,

Does anyone have any guidance on how to load pretrained weights using RoPE for different resolution input image for fine tuning?

It's unclear to me how EVA-02 went for 1024 MIM checkpoints fine tuned at 1536 for o365. I'd personally like to do the inverse.

What are the primary issues to avoid? Is it the changing size for the global attention indexes?

Appreciate any insight people have to offer. Let me know if I can share more information to make the discussion easier.

Thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment