Skip to content
This repository has been archived by the owner on Dec 6, 2023. It is now read-only.

Enable stream properly for HF based models #54

Open
filopedraz opened this issue Jul 17, 2023 · 0 comments
Open

Enable stream properly for HF based models #54

filopedraz opened this issue Jul 17, 2023 · 0 comments
Labels
enhancement New feature or request tech-debt technical debt

Comments

@filopedraz
Copy link
Collaborator

Description

Use https://github.com/huggingface/text-generation-inference library for HF based models.
@casperdcl casperdcl added enhancement New feature or request tech-debt technical debt labels Aug 21, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
enhancement New feature or request tech-debt technical debt
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@casperdcl @filopedraz