New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

关于多卡训练问题 #195

Open

ylc2580 opened this issue Aug 23, 2024 · 0 comments

ylc2580 commented Aug 23, 2024 •

edited

Loading

你好，我一个A40显卡，46G左右，可以batch=24训练，但是用是三个卡设置显存26、48、都会提示显存不够报错。给人的感觉好像是虽然用了三个卡都占用了，但实际是只用一个卡训练，其他两个卡是占用不使用状态，是我这边训练参数问题吗

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment