Add support for NTK-by-Part Rotary Embedding & set correct rotary bas… #1691

Job	Run time
Code Checks	6m 21s
Notebook Checks (ARENA_Content)	1m 4s
Compatibility Checks (3.9)	3m 24s
Notebook Checks (Colab_Compatibility)	1m 0s
Compatibility Checks (3.10)	3m 24s
Notebook Checks (BERT)	58s
Notebook Checks (Exploratory_Analysis_Demo)	5m 33s
Notebook Checks (Interactive_Neuroscope)	1m 16s
Notebook Checks (Main_Demo)	1m 46s
Notebook Checks (Othello_GPT)	57s
Notebook Checks (Patchscopes_Generation_Demo)	6m 42s
Build Docs	7m 50s
Deploy Docs	0s
	40m 15s

Provide feedback