Skip to content

Add support for NTK-by-Part Rotary Embedding & set correct rotary base for Llama-3.1 series #1689

Add support for NTK-by-Part Rotary Embedding & set correct rotary base for Llama-3.1 series

Add support for NTK-by-Part Rotary Embedding & set correct rotary base for Llama-3.1 series #1689

Annotations

2 warnings

Compatibility Checks (3.10)

succeeded Oct 26, 2024 in 4m 4s