Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(documentation): add context on why 48-vector element #4

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

Warkanlock
Copy link

@Warkanlock Warkanlock commented Dec 3, 2023

Creating just in case you want to include this information about adding context to the particular 48-element vector explained in the embedding part.

For non-knowledgable people in the field, it might look like a result of the inputs related to the actual architecture of the nano-gpt model.

For me, it took me a while to realize although it will be awesome to add context directly on the visualization

Source: https://github.com/karpathy/minGPT/blob/master/mingpt/model.py

Copy link

vercel bot commented Dec 3, 2023

@Warkanlock is attempting to deploy a commit to the Brendan's Team Team on Vercel.

A member of the Team first needs to authorize it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant