Skip to content

Add support for NTK-by-Part Rotary Embedding & set correct rotary base for Llama-3.1 series #1684

Add support for NTK-by-Part Rotary Embedding & set correct rotary base for Llama-3.1 series

Add support for NTK-by-Part Rotary Embedding & set correct rotary base for Llama-3.1 series #1684