Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How long does it take to train for each stage? including the (1) pre-training stage, (2) fine-tuning stage, (3) dataset-specific fine-tuning #8

Open
amos-x-wang opened this issue Nov 16, 2023 · 0 comments

Comments

@amos-x-wang
Copy link

Dear authors,

First of all, great work, and congratulations.

Excited by your great work, I am interested in reproducing the training.
From the paper, I understand there are 3 training stages in total, with different input image size, batch size, training steps for different stages. Each stage was trained using 8 GPUs with A100 (80GB) memory.

Could you please tell me how much time was spent in each stage? Thanks very much in advance.

Best regards,
Amos

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant