Code

Add embedding dimensions#3

Code

Draft

gkielian wants to merge 6 commits intoReaLLMASIC:masterReaLLMASIC/llm.c:masterfrom gkielian:add_reallmasic_dimensionsgkielian/llm.c:add_reallmasic_dimensionsCopy head branch name to clipboard

+128-6

Commits

Commits on Sep 13, 2024

• change default params: use tinyshakespeare and decrease LR

  karpathy

  committed
  bd8c604

  Copy full SHA for bd8c604

Commits on Sep 24, 2024

• cuda mode -> gpu mode

  Show description for 5b2e318
  msaroufim

  authored
  5b2e318

  Copy full SHA for 5b2e318

• Update README.md

  msaroufim

  authored
  315b8d1

  Copy full SHA for 315b8d1

Commits on Oct 2, 2024

• Merge pull request karpathy#766 from msaroufim/patch-1

  Show description for 7ecd890
  karpathy

  authored
  7ecd890

  Copy full SHA for 7ecd890

Commits on Oct 12, 2024

• Add options to use different softmax alternatives

  Show description for ba59fe9
  gkielian

  committed
  ba59fe9

  Copy full SHA for ba59fe9

Commits on Oct 22, 2024

• Add option for ReaLLMASIC heads and embd_dim

  Show description for 7c278a0
  gkielian

  committed
  7c278a0

  Copy full SHA for 7c278a0