Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Insufficient Memory: bad_alloc #3

Open
TreeLLi opened this issue Mar 4, 2018 · 1 comment
Open

Insufficient Memory: bad_alloc #3

TreeLLi opened this issue Mar 4, 2018 · 1 comment
Assignees

Comments

@TreeLLi
Copy link

TreeLLi commented Mar 4, 2018

Hello,
when I was trying to train the model with VGG16 base model, I got an error of bac_alloc related to the insufficient memory allocation on my DSVM with 4GB memory.

Basically, this is not a programming error. But I think pointing out the minimum requirements on the resource, like memory, will ease lots of pain for the people whose training aborted after running for a long time due to this problem.

Finally, here are some experiment results collected from the Linux DSVM:

  1. VGG16 + e2e: above 4GB but below 8GB
  2. VGG16 + 4-stage: around 17GB

Best wishes!

@karolzak
Copy link
Owner

Good find, I'll add that hint to readme

@karolzak karolzak self-assigned this Apr 17, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants