Skip to content

Commit

Permalink
Grab model data dynamically instead of hardcoded
Browse files Browse the repository at this point in the history 
- Dynamically resolve max token count
- Dynamically resolve tokenizers
- Use only stream function not both callback and stream and distinguish type of response instead

Signed-off-by: Tomas Slusny <[email protected]>
  • Loading branch information
@deathbeam
deathbeam committed Nov 2, 2024
1 parent ae6b0c0 commit f492023
Show file tree
Hide file tree
Showing 3 changed files with 276 additions and 287 deletions.
Loading

1 comment on commit f492023

@hrez
Copy link

@hrez hrez commented on f492023 Nov 5, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

https://api.githubcopilot.com/models call needs caching across vi restarts. It's slow to run it every time.

Please sign in to comment.