Skip to content

Add support for NTK-by-Part Rotary Embedding & set correct rotary base for Llama-3.1 series #1684

Add support for NTK-by-Part Rotary Embedding & set correct rotary base for Llama-3.1 series

Add support for NTK-by-Part Rotary Embedding & set correct rotary base for Llama-3.1 series #1684

Annotations

1 warning

Notebook Checks (Othello_GPT)

succeeded Oct 25, 2024 in 57s