Skip to content

Fix that if use_past_kv_cache is set to True models from the Bloom family produce weird outputs. #1735

Fix that if use_past_kv_cache is set to True models from the Bloom family produce weird outputs.

Fix that if use_past_kv_cache is set to True models from the Bloom family produce weird outputs. #1735