Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Question]: The process of refining Question is slow. #4181

Open
zzzqiii opened this issue Dec 23, 2024 · 4 comments
Open

[Question]: The process of refining Question is slow. #4181

zzzqiii opened this issue Dec 23, 2024 · 4 comments
Labels
question Further information is requested

Comments

@zzzqiii
Copy link

zzzqiii commented Dec 23, 2024

Describe your problem

206 pdfs were uploaded and parsed. Then I tried to ask a simple question about something in the knowledge base. However the responding time is too long. A question took about 4 mins to respond. Especially, the process of refing question and retrieval took a long time. Are there ways to solve this problem?
88129037b394463e7034b1e05e1962c

@zzzqiii zzzqiii added the question Further information is requested label Dec 23, 2024
@KevinHuSh
Copy link
Collaborator

Question refinments will touch LLM to do the job. So, it's time consuming. You could disable it.
The retrival time depends on ES. I guess you need to deploy multiple nodes for ES and enlarge the RAM ES can use.

@zzzqiii
Copy link
Author

zzzqiii commented Dec 23, 2024

@KevinHuSh

Thank you for your reply!

Could you confirm if setting it to 'empty' will disable the feature? Or is there another way to turn it off?
image

Additionally, regarding the retrieval time, you mentioned it depends on ES and suggested deploying multiple nodes for ES and enlarging the RAM ES can use. Could you please provide more details or documentation on how to deploy multiple ES nodes and configure the RAM usage?

@KevinHuSh
Copy link
Collaborator

Yes, 'empty' will disable the feature.
About ES. Check this out.

@zzzqiii
Copy link
Author

zzzqiii commented Dec 24, 2024

@KevinHuSh

Thank you for your suggestion! I have already disabled question refinments, but it still takes a long time. Could you help me understand why this might be happening and if there are other configurations I need to adjust to improve the performance?
20b2d568bd33de29c67dbfd4d3c9f64

This is my setting.
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants