Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for post-processing kwargs in image-text-to-text pipeline #35374

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

yonigozlan
Copy link
Member

What does this PR do?

This PR adds support for post-processing kwargs for the image-text-to-text pipeline. Following what is done in the text-generation pipeline, for now only clean_up_tokenization_spaces is supported, but more can be added in the future.

It also fixes two bugs with the pipeline

  • One where the preprocessing kwargs given in the init of the pipeline would be overriden when calling it with no preprocessing kwargs.
  • Another where the pipeline would crash with chat templates when images=image where image is not a list

Who can review?

@Rocketknight1

@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants