Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The system does not output a response #4201

Open
1 task done
prettyprettyboy opened this issue Dec 24, 2024 · 1 comment
Open
1 task done

The system does not output a response #4201

prettyprettyboy opened this issue Dec 24, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@prettyprettyboy
Copy link

Is there an existing issue for the same bug?

  • I have checked the existing issues.

RAGFlow workspace code commit ID

none

RAGFlow image version

v0.13.0

Other environment information

No response

Actual behavior

I am using a model with a built-in image to launch on two GPUs,so the flag embedding also starts the model on the GPU.After serving dozens of users at this scale for a period of time,such as two days,the memory of these two GPUs has increased to a certain value,but it is within the normal range without memory overflow.However,the utilization rate of one of the GPUs has always been 100%,regardless of whether it is being used or not.When questions are asked again,the model cannot output.At this time,testing the VLLM backend large model separately is not a problem,so the issue must be with the previous retrieval or sorting.

Expected behavior

No response

Steps to reproduce

This issue only occurs after a certain number of users have utilized it,and it has now reliably appeared three times.

Additional information

No response

@prettyprettyboy prettyprettyboy added the bug Something isn't working label Dec 24, 2024
@JinHai-CN
Copy link
Contributor

JinHai-CN commented Dec 24, 2024

You may try the latest version, and check if the issue is still existed or not.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants