Skip to content

Fix that if use_past_kv_cache is set to True models from the Bloom family produce weird outputs. #1731

Fix that if use_past_kv_cache is set to True models from the Bloom family produce weird outputs.

Fix that if use_past_kv_cache is set to True models from the Bloom family produce weird outputs. #1731

Annotations

1 warning

Notebook Checks (Colab_Compatibility)

succeeded Nov 13, 2024 in 1m 18s