eaddario
/

DeepSeek-R1-Distill-Qwen-7B-GGUF

Text Generation

Model card Files Files and versions

DeepSeek-R1-Distill-Qwen-7B-GGUF

113 GB

1 contributor

History: 81 commits

eaddario's picture

Layer-wise quantization IQ4_NL

3c69ca5 verified 7 months ago

imatrix
Regenerate importance matrices 7 months ago
logits
Regenerate logits 7 months ago
scores
Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores 7 months ago
.gitattributes

1.65 kB

Update lfs attributes and ignores 9 months ago
.gitignore

6.78 kB

Update lfs attributes and ignores 9 months ago
DeepSeek-R1-Distill-Qwen-7B-F16.gguf

15.2 GB
xet

Rename to F16 9 months ago
DeepSeek-R1-Distill-Qwen-7B-IQ3_M.gguf

3.29 GB
xet

Selective quantization IQ3_M 7 months ago
DeepSeek-R1-Distill-Qwen-7B-IQ3_S.gguf

3.09 GB
xet

Selective quantization IQ3_S 7 months ago
DeepSeek-R1-Distill-Qwen-7B-IQ4_NL.gguf

4.18 GB
xet

Layer-wise quantization IQ4_NL 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q3_K_L.gguf

3.54 GB
xet

Layer-wise quantization Q3_K_L 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q3_K_M.gguf

3.37 GB
xet

Layer-wise quantization Q3_K_M 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q3_K_S.gguf

3.14 GB
xet

Layer-wise quantization Q3_K_S 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q4_K_M.gguf

4.18 GB
xet

Layer-wise quantization Q4_K_M 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q4_K_S.gguf

4.06 GB
xet

Layer-wise quantization Q4_K_S 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q5_K_M.gguf

5.09 GB
xet

Layer-wise quantization Q5_K_M 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q5_K_S.gguf

4.97 GB
xet

Layer-wise quantization Q5_K_S 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q6_K.gguf

6.23 GB
xet

Layer-wise quantization Q6_K 7 months ago
DeepSeek-R1-Distill-Qwen-7B-Q8_0.gguf

7.27 GB
xet

Layer-wise quantization Q8_0 7 months ago
README.md

19.1 kB

Update README.md 7 months ago