FineData

Team

community

AI & ML interests

We release large pre-training datasets to accelerate open LLM development. Part of the Hugging Face Science team (hf.co/science)

Recent Activity

guipenedo new activity 1 day ago

HuggingFaceFW/finewiki:Filtered Cebuano?

hynky new activity 4 days ago

HuggingFaceFW/finepdfs:OCR or not classifier

hynky new activity 4 days ago

HuggingFaceFW/finepdfs:A Few Questions About the Implementation Details of the finepdfs Project

View all activity

Papers

FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

View all Papers

HuggingFaceFW 's models 30

HuggingFaceFW/fineweb-edu-classifier

Text Classification • 0.1B • Updated Nov 17, 2024 • 1.47k • • 197

HuggingFaceFW/Datasets-Metrics-Viewer-Data

Updated Sep 2, 2024

HuggingFaceFW/ablation-model-fineweb-edu

Text Generation • 2B • Updated Jun 11, 2024 • 418 • 16

HuggingFaceFW/ablation-exp-filter-custom-all_filters-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 1 • 1

HuggingFaceFW/ablation-exp-filter-custom-line_char_duplicated_0.01-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 2

HuggingFaceFW/ablation-exp-filter-custom-line_ratio_0.67-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 1

HuggingFaceFW/ablation-exp-filter-custom-lines_punct_0.12-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 12 • 3

HuggingFaceFW/ablation-exp-filter-baseline_c4-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 5 • 2

HuggingFaceFW/ablation-exp-filter-baseline_cc-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 3 • 4

HuggingFaceFW/ablation-exp-filter-c4-word_lengths-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 2 • 2

HuggingFaceFW/ablation-exp-filter-c4-tpunct-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 2 • 1

HuggingFaceFW/ablation-exp-filter-c4-curly_bracket-28BT

Text Generation • 2B • Updated Jun 4, 2024

HuggingFaceFW/ablation-exp-filter-c4-all-28BT

Text Generation • 2B • Updated Jun 4, 2024

HuggingFaceFW/ablation-exp-filter-c4-all_except_tpunct-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 3

HuggingFaceFW/ablation-exp-textext-wet-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 2

HuggingFaceFW/ablation-exp-textext-warc_trafilatura-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 1

HuggingFaceFW/ablation-exp-dedup-ind_mh-global_line-350BT

Text Generation • 2B • Updated Jun 4, 2024 • 2

HuggingFaceFW/ablation-exp-dedup-ind_mh-global_3line-350BT

Text Generation • 2B • Updated Jun 4, 2024

HuggingFaceFW/ablation-exp-fw-base_filt-ind_mh-c4_filters-350BT

Text Generation • 2B • Updated Jun 4, 2024 • 1

HuggingFaceFW/ablation-exp-dedup-ind_mh-global_line_minwords-350BT

Text Generation • 2B • Updated Jun 4, 2024

HuggingFaceFW/ablation-exp-dedup-independent_minhash-350BT

Text Generation • 2B • Updated Jun 4, 2024 • 1

HuggingFaceFW/ablation-exp-fw-base_filtering-350BT

Text Generation • 2B • Updated Jun 4, 2024

HuggingFaceFW/ablation-exp-dedup-global_minhash-350BT

Text Generation • 2B • Updated Jun 4, 2024 • 1

HuggingFaceFW/ablation-model-redpajama2

Text Generation • 2B • Updated May 5, 2024

HuggingFaceFW/ablation-model-the-pile

Text Generation • 2B • Updated Apr 25, 2024 • 3 • 1

HuggingFaceFW/ablation-model-slimpajama

Text Generation • 2B • Updated Apr 25, 2024 • 1 • 2

HuggingFaceFW/ablation-model-dolma-v1_6

Text Generation • 2B • Updated Apr 25, 2024 • 3 • 2

HuggingFaceFW/ablation-model-c4

Text Generation • 2B • Updated Apr 25, 2024 • 11 • 4

HuggingFaceFW/ablation-model-refinedweb

Text Generation • 2B • Updated Apr 25, 2024 • 3 • 3

HuggingFaceFW/ablation-model-fineweb-v1

Text Generation • 2B • Updated Apr 25, 2024 • 606 • 14