Open the Datasets Table in a new tab | Back to LifeArchitect.ai
Open the Datasets Table in a new tab | Back to LifeArchitect.ai
Datasets Table, list of datasets for large language models, as used by all major AI labs, including:
DCLM-Pool, RedPajama-Data-v2, Piper monorepo, The Stack v2, MNBVC (Massive Never-ending BT Vast Chinese corpus, Claude-3.5 dataset, FineWeb, GPT-4 dataset, FineWeb-Edu-score-2, CulturaX, HPLT (High Performance Language Technologies), RefinedWeb, MassiveText ML, Matrix, Cultura-Y, DCLM-Baseline, PaLM 2 dataset, Dolma, Infiniset, MADLAD-400, MassiveText EN, The Stack v1, InternLM, Stability New Pile, FineWeb-Edu 1.3T, LLaMA, RedPajama, SlimPajama, Common Corpus, ROOTS, The Pile v1, StarCoder dataset (The Stack 1.2 subset), GPT-3 dataset, RoBERTa dataset, YouTube-Commons, Cosmopedia v0.1, GPT-2 dataset, GPT-1 dataset