Skip to content

Add support for NTK-by-Part Rotary Embedding & set correct rotary base for Llama-3.1 series #1683

Add support for NTK-by-Part Rotary Embedding & set correct rotary base for Llama-3.1 series

Add support for NTK-by-Part Rotary Embedding & set correct rotary base for Llama-3.1 series #1683

Annotations

1 warning

Notebook Checks (Colab_Compatibility)

succeeded Oct 25, 2024 in 1m 15s