Skip to content

Commit

Permalink
Add gpt-4o-2024-08-06 to token map (#701)
Browse files Browse the repository at this point in the history
* Have all gpt-4o tokens use the same limit
  • Loading branch information
vocode-petern authored Sep 5, 2024
1 parent 84c2971 commit 1bfc1e2
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion vocode/streaming/agent/token_utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -56,13 +56,14 @@
"gpt-4-0125-preview": 127940,
"gpt-4-turbo": 127940,
"gpt-4o": 127940,
"gpt-4o-2024-05-13": 127940,
}


def get_chat_gpt_max_tokens(model_name: str):
if model_name.startswith("ft:"):
model_name = model_name.split(":")[1]
if model_name.startswith("gpt-4o"):
model_name = "gpt-4o"

if model_name in CHAT_GPT_MAX_TOKENS:
return CHAT_GPT_MAX_TOKENS[model_name]
Expand Down

0 comments on commit 1bfc1e2

Please sign in to comment.