CPU intensive
#1583
-
|
Has anyone ran chat completion with a webserver? Something (im guessing the tiktoken) is extremely cpu intensive and can hang requests. Another related question, if this is because of the tokenization, why is tiktoken needed? The open ai api already returns the token count. |
Beta Was this translation helpful? Give feedback.
Answered by
AlexXi19
Jun 19, 2023
Replies: 1 comment
-
|
Used worker threads |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
AlexXi19
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Used worker threads