Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

推断的时候报错 #14

Open
dayu1979 opened this issue Jul 8, 2023 · 3 comments
Open

推断的时候报错 #14

dayu1979 opened this issue Jul 8, 2023 · 3 comments

Comments

@dayu1979
Copy link

dayu1979 commented Jul 8, 2023

Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! (when checking argument for argument index in method wrapper_CUDA__index_select)
@ssbuild
Copy link
Owner

ssbuild commented Jul 8, 2023

which infer ? and show more error

@dayu1979
Copy link
Author

dayu1979 commented Jul 8, 2023 •
edited
Loading

应该是model_zoo的ChatGLMTokenizer类的问题，返回的tensor在cpu上，而模型是在gpu，导致该错误发生。

@ssbuild
Copy link
Owner

ssbuild commented Jul 8, 2023

yes , fixed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@dayu1979 @ssbuild