Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Model is significantly memory intensive #7

Open
yhteoh opened this issue May 16, 2023 · 1 comment
Open

Model is significantly memory intensive #7

yhteoh opened this issue May 16, 2023 · 1 comment
Assignees
@davidfitzek
Labels
note Something to note

Comments

@yhteoh
Copy link
Contributor

yhteoh commented May 16, 2023

For the small model, I am training with a batch_size of 32 only and sampling 16x16 configurations constantly runs out of memory (for sample size 32) when ran on a graphics card with 6GB VRAM.

Issue #4 may or may not be related.
@yhteoh yhteoh added the note Something to note label May 18, 2023
@davidfitzek davidfitzek self-assigned this May 23, 2023
@davidfitzek
Copy link
Collaborator

Inspect model during training, inference and look for bottlenecks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@davidfitzek davidfitzek

Labels
note Something to note
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@davidfitzek @yhteoh