Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

do_sample=False for NPU in chat_sample, add NPU to README #1637

Merged
merged 2 commits into from
Jan 28, 2025

Conversation

helena-intel
Copy link
Collaborator

  • make chat_sample work out of the box on NPU by forcing do_sample=False for NPU
  • add NPU info to text_generation samples README

and a small unrelated change:

  • change pip install command for exporting models that are already on huggingface-hub. No need to install all of PyTorch and transformers if you only need to download a model.

@github-actions github-actions bot added the category: samples GenAI samples label Jan 28, 2025
@ilya-lavrenov ilya-lavrenov added this to the 2025.1 milestone Jan 28, 2025
@ilya-lavrenov ilya-lavrenov self-assigned this Jan 28, 2025
@ilya-lavrenov ilya-lavrenov added this pull request to the merge queue Jan 28, 2025
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Jan 28, 2025
@Wovchena Wovchena added this pull request to the merge queue Jan 28, 2025
Merged via the queue into openvinotoolkit:master with commit 4521bb6 Jan 28, 2025
60 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: samples GenAI samples
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants