1.24 MB

1 contributor

History: 5 commits

eaddario

Add GGUF internal file structure

50c9a1e verified 7 months ago

DeepSeek-R1-Distill-Qwen-7B-F16.arc

821 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-F16.hsw

794 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-F16.md

89.9 kB

Add GGUF internal file structure 7 months ago
DeepSeek-R1-Distill-Qwen-7B-F16.mmlu

821 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-F16.tqa

821 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-F16.wng

807 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-IQ3_M.md

91.5 kB

Add GGUF internal file structure 7 months ago
DeepSeek-R1-Distill-Qwen-7B-IQ3_S.md

91.5 kB

Add GGUF internal file structure 7 months ago
DeepSeek-R1-Distill-Qwen-7B-IQ4_NL.md

91.3 kB

Add GGUF internal file structure 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q3_K_L.md

90.5 kB

Add GGUF internal file structure 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q3_K_M.md

90.5 kB

Add GGUF internal file structure 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q3_K_S.md

90.5 kB

Add GGUF internal file structure 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q4_K_M.md

90.5 kB

Add GGUF internal file structure 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q4_K_S.md

90.5 kB

Add GGUF internal file structure 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q5_K_M.md

90.5 kB

Add GGUF internal file structure 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q5_K_S.md

90.5 kB

Add GGUF internal file structure 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q6_K.md

90.5 kB

Add GGUF internal file structure 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q8_0.md

90.5 kB

Add GGUF internal file structure 7 months ago
DeepSeek-R1-Distill-Qwen-7B-iq3_m.arc

823 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-iq3_m.hsw

796 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-iq3_m.mmlu

823 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-iq3_m.ppx

1.07 kB

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-iq3_m.tqa

823 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-iq3_m.wng

809 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-iq3_s.arc

823 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-iq3_s.hsw

796 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-iq3_s.mmlu

823 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-iq3_s.ppx

1.07 kB

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-iq3_s.tqa

823 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-iq3_s.wng

809 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-iq4_nl.arc

824 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-iq4_nl.hsw

797 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-iq4_nl.mmlu

824 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-iq4_nl.ppx

1.07 kB

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-iq4_nl.tqa

824 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-iq4_nl.wng

810 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-q3_k_l.arc

824 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-q3_k_l.hsw

797 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-q3_k_l.mmlu

824 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-q3_k_l.ppx

1.07 kB

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-q3_k_l.tqa

824 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-q3_k_l.wng

810 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-q3_k_m.arc

824 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-q3_k_m.hsw

797 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-q3_k_m.mmlu

824 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-q3_k_m.ppx

1.07 kB

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-q3_k_m.tqa

824 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-q3_k_m.wng

810 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-q3_k_s.arc

824 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
DeepSeek-R1-Distill-Qwen-7B-q3_k_s.hsw

797 Bytes

Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago