-
Notifications
You must be signed in to change notification settings - Fork 16k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
community: Chat Huggingface and HuggingFace TGI llms #15582
Conversation
The latest updates on your projects. Learn more about Vercel for Git ↗︎ 1 Ignored Deployment
|
@hwchase17 Can you please help me merge this PR? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
cc @andrewrreed
@andrewrreed @baskaryan I have fixed the spelling error occurred during the last check. |
libs/community/langchain_community/llms/huggingface_text_gen_inference.py
Outdated
Show resolved
Hide resolved
…nference.py Co-authored-by: Bagatur <[email protected]>
- Re-lock the `libs/community/poetry.lock` file - Add `text-generation` to `libs/community/pyproject.toml` - Add `pytest` for `libs/community/tests/integration_tests/llms/test_huggingface_text_gen_inference.py` - Re-lint and format
@baskaryan I have pushed 0f9784c to resolve library diffs during CI. Just tell me if there are more things need to be changed. Thanks a lot! |
@baskaryan Can you please help me merge and close this PR? Thanks a lot! |
closing because this is against the deprecated community huggingface integrations. Feel free to resubmit against the partner package (libs/partners/huggingface) if it's still missing there! |
community:
_resolve_model_id()
is only called whenmodel_id
is not explicitly defined, in order to avoid callinglist_inference_endpoints
when connectingHuggingFaceTextGenInference
to a self-hosted TGI server.HuggingFaceTextGenInference
clients that send request to a HuggingFace-deployed Inference Endpoints, a Bearer Token is needed for authorization.HuggingFaceTextGenInference