-
Notifications
You must be signed in to change notification settings - Fork 6
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Refactor tokenization #191
Merged
Merged
Commits on Aug 3, 2023
-
Configuration menu - View commit details
-
Copy full SHA for aea5144 - Browse repository at this point
Copy the full SHA aea5144View commit details -
Configuration menu - View commit details
-
Copy full SHA for 973fef4 - Browse repository at this point
Copy the full SHA 973fef4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 457e2b0 - Browse repository at this point
Copy the full SHA 457e2b0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1cc3644 - Browse repository at this point
Copy the full SHA 1cc3644View commit details -
Configuration menu - View commit details
-
Copy full SHA for be96003 - Browse repository at this point
Copy the full SHA be96003View commit details -
Configuration menu - View commit details
-
Copy full SHA for c80bc2a - Browse repository at this point
Copy the full SHA c80bc2aView commit details -
Configuration menu - View commit details
-
Copy full SHA for a3366af - Browse repository at this point
Copy the full SHA a3366afView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3355c24 - Browse repository at this point
Copy the full SHA 3355c24View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1142760 - Browse repository at this point
Copy the full SHA 1142760View commit details -
remove deprecated kwarg to process_weights_
Upgrading transformer_lens to 1.4.0 caused `HookedTransformer.process_weights_()` to no longer accept the keyword arg `move_state_dict_to_device` However, I'm not sure if this was important in the first place. If any issues come up, move the state dict to device manually in `ZanjHookedTransformer._load_state_dict_wrapper()` where all this was happening in the first place
Configuration menu - View commit details
-
Copy full SHA for 571acd8 - Browse repository at this point
Copy the full SHA 571acd8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9114d86 - Browse repository at this point
Copy the full SHA 9114d86View commit details -
updated changed dataset config key
since we removed tokenizer stuff from the dataset
Configuration menu - View commit details
-
Copy full SHA for 2ee2f3e - Browse repository at this point
Copy the full SHA 2ee2f3eView commit details -
fixed eval_model nb, added ZanjHookedTransformer.config ref
the `eval_model.ipynb` notebook has a function `testdata_plot_predicted_path` which was using `model.zanj_model_config` to get the tokenizer, an attribute missing from the `RandomBaseline` class since it only inherits from `HookedTransformer` to fix this: - `ZanjHookedTransformer` now has a `config` property which just accesses the `zanj_model_config` used by the parent `ConfiguredModel` - `testdata_plot_predicted_path` now uses `model.config` everywhere
Configuration menu - View commit details
-
Copy full SHA for a06378d - Browse repository at this point
Copy the full SHA a06378dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 933e013 - Browse repository at this point
Copy the full SHA 933e013View commit details
Commits on Aug 5, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 234175e - Browse repository at this point
Copy the full SHA 234175eView commit details -
Configuration menu - View commit details
-
Copy full SHA for a23e2c0 - Browse repository at this point
Copy the full SHA a23e2c0View commit details
Commits on Aug 6, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 144daa8 - Browse repository at this point
Copy the full SHA 144daa8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 16bc51e - Browse repository at this point
Copy the full SHA 16bc51eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5a577a1 - Browse repository at this point
Copy the full SHA 5a577a1View commit details
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.