Skip to content

Commit

Permalink
Deploying to gh-pages from @ 332d8d7 🚀
Browse files Browse the repository at this point in the history
  • Loading branch information
jbloomAus committed Jul 31, 2024
1 parent 051dad8 commit def5c1a
Show file tree
Hide file tree
Showing 85 changed files with 5,912 additions and 5,873 deletions.
Binary file modified .doctrees/environment.pickle
Binary file not shown.
Binary file not shown.
Binary file modified .doctrees/generated/demos/Exploratory_Analysis_Demo.doctree
Binary file not shown.
Binary file modified .doctrees/generated/demos/Main_Demo.doctree
Binary file not shown.
Binary file modified .doctrees/generated/model_properties_table.doctree
Binary file not shown.
1,768 changes: 884 additions & 884 deletions .doctrees/nbsphinx/generated/demos/Exploratory_Analysis_Demo.ipynb

Large diffs are not rendered by default.

2,298 changes: 1,146 additions & 1,152 deletions .doctrees/nbsphinx/generated/demos/Main_Demo.ipynb

Large diffs are not rendered by default.

2 changes: 2 additions & 0 deletions _sources/generated/model_properties_table.md.txt
Original file line number Diff line number Diff line change
Expand Up @@ -163,6 +163,8 @@
| gemma-7b | 7.8B | 28 | 3072 | 16 | gelu | 8192 | 256000 | 256 | 24576 | 16 |
| gemma-2b-it | 2.1B | 18 | 2048 | 8 | gelu | 8192 | 256000 | 256 | 16384 | 1 |
| gemma-7b-it | 7.8B | 28 | 3072 | 16 | gelu | 8192 | 256000 | 256 | 24576 | 16 |
| gemma-2-2b | 2.1B | 26 | 2304 | 8 | gelu_pytorch_tanh | 8192 | 256000 | 256 | 9216 | 4 |
| gemma-2-2b-it | 2.1B | 26 | 2304 | 8 | gelu_pytorch_tanh | 8192 | 256000 | 256 | 9216 | 4 |
| gemma-2-9b | 8.9B | 42 | 3584 | 16 | gelu_pytorch_tanh | 8192 | 256000 | 256 | 14336 | 8 |
| gemma-2-9b-it | 8.9B | 42 | 3584 | 16 | gelu_pytorch_tanh | 8192 | 256000 | 256 | 14336 | 8 |
| gemma-2-27b | 27B | 46 | 4608 | 32 | gelu_pytorch_tanh | 8192 | 256000 | 128 | 36864 | 16 |
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_37285d613390727b_gated_mlp_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
<aside class="hidden">
<button type="button" class="button_next_chunk" data-shortcut="j"/>
Expand Down Expand Up @@ -166,7 +166,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_37285d613390727b_gated_mlp_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
</div>
</footer>
Expand Down
4 changes: 2 additions & 2 deletions _static/coverage/d_37285d613390727b_gated_mlp_4bit_py.html
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_37285d613390727b_mlp_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
<aside class="hidden">
<button type="button" class="button_next_chunk" data-shortcut="j"/>
Expand Down Expand Up @@ -168,7 +168,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_37285d613390727b_mlp_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
</div>
</footer>
Expand Down
4 changes: 2 additions & 2 deletions _static/coverage/d_37285d613390727b_gated_mlp_py.html
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_37285d613390727b_gated_mlp_4bit_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
<aside class="hidden">
<button type="button" class="button_next_chunk" data-shortcut="j"/>
Expand Down Expand Up @@ -164,7 +164,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_37285d613390727b_gated_mlp_4bit_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
</div>
</footer>
Expand Down
4 changes: 2 additions & 2 deletions _static/coverage/d_37285d613390727b_mlp_py.html
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_37285d613390727b_moe_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
<aside class="hidden">
<button type="button" class="button_next_chunk" data-shortcut="j"/>
Expand Down Expand Up @@ -140,7 +140,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_37285d613390727b_moe_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
</div>
</footer>
Expand Down
4 changes: 2 additions & 2 deletions _static/coverage/d_37285d613390727b_moe_py.html
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_db46118ef83ad831_pos_embed_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
<aside class="hidden">
<button type="button" class="button_next_chunk" data-shortcut="j"/>
Expand Down Expand Up @@ -204,7 +204,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_db46118ef83ad831_pos_embed_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
</div>
</footer>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_65d4430f90bfb219_mlp_factory_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
<aside class="hidden">
<button type="button" class="button_next_chunk" data-shortcut="j"/>
Expand Down Expand Up @@ -128,7 +128,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_65d4430f90bfb219_mlp_factory_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
</div>
</footer>
Expand Down
4 changes: 2 additions & 2 deletions _static/coverage/d_65d4430f90bfb219_mlp_factory_py.html
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_af97b5493da09a14_head_detector_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
<aside class="hidden">
<button type="button" class="button_next_chunk" data-shortcut="j"/>
Expand Down Expand Up @@ -112,7 +112,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_af97b5493da09a14_head_detector_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
</div>
</footer>
Expand Down
4 changes: 2 additions & 2 deletions _static/coverage/d_712808f24eb400fe___init___py.html
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_c1ea89878f9b2ac7___init___py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
<aside class="hidden">
<button type="button" class="button_next_chunk" data-shortcut="j"/>
Expand All @@ -91,7 +91,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_c1ea89878f9b2ac7___init___py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
</div>
</footer>
Expand Down
4 changes: 2 additions & 2 deletions _static/coverage/d_af97b5493da09a14_ActivationCache_py.html
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_af97b5493da09a14_FactoredMatrix_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
<aside class="hidden">
<button type="button" class="button_next_chunk" data-shortcut="j"/>
Expand Down Expand Up @@ -1191,7 +1191,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_af97b5493da09a14_FactoredMatrix_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
</div>
</footer>
Expand Down
4 changes: 2 additions & 2 deletions _static/coverage/d_af97b5493da09a14_FactoredMatrix_py.html
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_af97b5493da09a14_HookedEncoder_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
<aside class="hidden">
<button type="button" class="button_next_chunk" data-shortcut="j"/>
Expand Down Expand Up @@ -365,7 +365,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_af97b5493da09a14_HookedEncoder_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
</div>
</footer>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_af97b5493da09a14_HookedTransformer_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
<aside class="hidden">
<button type="button" class="button_next_chunk" data-shortcut="j"/>
Expand Down Expand Up @@ -507,7 +507,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_af97b5493da09a14_HookedTransformer_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
</div>
</footer>
Expand Down
4 changes: 2 additions & 2 deletions _static/coverage/d_af97b5493da09a14_HookedEncoder_py.html
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_af97b5493da09a14_HookedEncoderDecoder_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
<aside class="hidden">
<button type="button" class="button_next_chunk" data-shortcut="j"/>
Expand Down Expand Up @@ -461,7 +461,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_af97b5493da09a14_HookedEncoderDecoder_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
</div>
</footer>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_af97b5493da09a14_SVDInterpreter_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
<aside class="hidden">
<button type="button" class="button_next_chunk" data-shortcut="j"/>
Expand Down Expand Up @@ -444,7 +444,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_af97b5493da09a14_SVDInterpreter_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
</div>
</footer>
Expand Down
4 changes: 2 additions & 2 deletions _static/coverage/d_af97b5493da09a14_HookedTransformer_py.html
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_af97b5493da09a14_HookedTransformerConfig_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
<aside class="hidden">
<button type="button" class="button_next_chunk" data-shortcut="j"/>
Expand Down Expand Up @@ -2537,7 +2537,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_af97b5493da09a14_HookedTransformerConfig_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
</div>
</footer>
Expand Down
4 changes: 2 additions & 2 deletions _static/coverage/d_af97b5493da09a14_SVDInterpreter_py.html
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_af97b5493da09a14___init___py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
<aside class="hidden">
<button type="button" class="button_next_chunk" data-shortcut="j"/>
Expand Down Expand Up @@ -253,7 +253,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_af97b5493da09a14___init___py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
</div>
</footer>
Expand Down
4 changes: 2 additions & 2 deletions _static/coverage/d_af97b5493da09a14___init___py.html
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_db46118ef83ad831___init___py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
<aside class="hidden">
<button type="button" class="button_next_chunk" data-shortcut="j"/>
Expand Down Expand Up @@ -118,7 +118,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_db46118ef83ad831___init___py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
</div>
</footer>
Expand Down
4 changes: 2 additions & 2 deletions _static/coverage/d_af97b5493da09a14_evals_py.html
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_65d4430f90bfb219_activation_function_factory_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
<aside class="hidden">
<button type="button" class="button_next_chunk" data-shortcut="j"/>
Expand Down Expand Up @@ -427,7 +427,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_65d4430f90bfb219_activation_function_factory_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
</div>
</footer>
Expand Down
4 changes: 2 additions & 2 deletions _static/coverage/d_af97b5493da09a14_head_detector_py.html
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_af97b5493da09a14_hook_points_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
<aside class="hidden">
<button type="button" class="button_next_chunk" data-shortcut="j"/>
Expand Down Expand Up @@ -361,7 +361,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_af97b5493da09a14_hook_points_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
</div>
</footer>
Expand Down
4 changes: 2 additions & 2 deletions _static/coverage/d_af97b5493da09a14_hook_points_py.html
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_af97b5493da09a14_loading_from_pretrained_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
<aside class="hidden">
<button type="button" class="button_next_chunk" data-shortcut="j"/>
Expand Down Expand Up @@ -787,7 +787,7 @@ <h2>
<a id="nextFileLink" class="nav" href="d_af97b5493da09a14_loading_from_pretrained_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.4.4">coverage.py v7.4.4</a>,
created at 2024-07-15 14:20 +0000
created at 2024-07-31 15:53 +0000
</p>
</div>
</footer>
Expand Down
Loading

0 comments on commit def5c1a

Please sign in to comment.