Skip to content

add miniPile dataset for pretraining, 1M entries (solves the 'out of data' at 40 iters issue) #101

add miniPile dataset for pretraining, 1M entries (solves the 'out of data' at 40 iters issue)

add miniPile dataset for pretraining, 1M entries (solves the 'out of data' at 40 iters issue) #101