Replies: 1 comment 2 replies
-
Can anybody help me please? Many thanks? |
Beta Was this translation helpful? Give feedback.
2 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi,
when I use the OpenAI API I get a return value called
finish_reason
.It can have the value of
stop
if the last token was the stop token orthe value of
length
means the API stopped the completion because of running into a token limit.How do I see if the stop token was returned or not when I use vLLM?
How do I see if the token limit was reached?
Beta Was this translation helpful? Give feedback.
All reactions