Skip to content

Add support for NTK-by-Part Rotary Embedding & set correct rotary base for Llama-3.1 series #1684

Add support for NTK-by-Part Rotary Embedding & set correct rotary base for Llama-3.1 series

Add support for NTK-by-Part Rotary Embedding & set correct rotary base for Llama-3.1 series #1684

Annotations

1 warning

Notebook Checks (Exploratory_Analysis_Demo)

succeeded Oct 25, 2024 in 5m 11s