Hugging Face's logo

turboderp
/
Mixtral-8x7B-Instruct-v0.1-exl3

exl3
Model card Files
xet
Community
turboderp commited on
Commit
f43115b
·
verified ·
1 Parent(s): e6da0cb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -12,3 +12,7 @@ EXL3 quants of [Mixtral-8x7B-Instruct-v0.1](https://huggingface.co/mistralai/Mix
12
  [5.00 bits per weight](https://huggingface.co/turboderp/Mixtral-8x7B-Instruct-v0.1-exl3/tree/5.0bpw)
13
  [6.00 bits per weight](https://huggingface.co/turboderp/Mixtral-8x7B-Instruct-v0.1-exl3/tree/6.0bpw)
14
  [8.00 bits per weight / H8](https://huggingface.co/turboderp/Mixtral-8x7B-Instruct-v0.1-exl3/tree/8.0bpw_H8)
 
 
 
 
 
12
  [5.00 bits per weight](https://huggingface.co/turboderp/Mixtral-8x7B-Instruct-v0.1-exl3/tree/5.0bpw)
13
  [6.00 bits per weight](https://huggingface.co/turboderp/Mixtral-8x7B-Instruct-v0.1-exl3/tree/6.0bpw)
14
  [8.00 bits per weight / H8](https://huggingface.co/turboderp/Mixtral-8x7B-Instruct-v0.1-exl3/tree/8.0bpw_H8)
15
+
16
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6383dc174c48969dcf1b4fce/S8xWcQVnb9hNi4yhc_LfM.png)
17
+
18
+ (Couldn't find any GGUF or AWQ versions that still work.)