Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for other pooling methods in python backend #414

Open
OskarLiew opened this issue Sep 26, 2024 · 0 comments
Open

Add support for other pooling methods in python backend #414

OskarLiew opened this issue Sep 26, 2024 · 0 comments

Comments

@OskarLiew
Copy link

Feature request

The python backend currently only supports CLS pooling

Motivation

I am currently deploying on intel gaudi hardware, and their fork of TEI currently only has support for the python backend. The model that I use has half the error rate when using mean pooling. Rather than only contributing to their fork I thought I could submit the update upstream.

Your contribution

I have made code changes and will publish a PR right away when I am done writing this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant