codelion/dclm-baseline-1B
Viewer
•
Updated
•
774k
•
99
Pre-training Dataset Samples
A collection of pre-training datasets samples of sizes 10M, 100M and 1B tokens. Ideal for use in quick experimentation and ablations.
-
-
codelion/fineweb-edu-1B
Viewer • Updated • 970k • 59 -
sumuks/essential-web-v1.0-sample-1B
Viewer • Updated • 1.83M • 21 -
codelion/finepdfs-1B
Viewer • Updated • 186k • 113 -
codelion/dclm-baseline-100M
Viewer • Updated • 77.2k • 24 -
codelion/fineweb-edu-100M
Viewer • Updated • 115k • 30 -
sumuks/essential-web-v1.0-sample-100M
Viewer • Updated • 183k • 36 -
codelion/finepdfs-100M
Viewer • Updated • 18.6k • 1.55k • 1 -
codelion/dclm-baseline-10M
Viewer • Updated • 7.95k • 7 -
codelion/fineweb-edu-10M
Viewer • Updated • 9.46k • 13 -
sumuks/essential-web-v1.0-sample-10M
Viewer • Updated • 18.3k • 20 • 1 -
codelion/finepdfs-10M
Viewer • Updated • 7.54k • 15