turboderp
/

Mistral-7B-Instruct-v0.3-exl3

Model card Files Files and versions

EXL3 quants of Mistral-7B-Instruct-v0.3

2.00 bits per weight
2.25 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight
8.00 bits per weight / H8

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for turboderp/Mistral-7B-Instruct-v0.3-exl3

Base model

mistralai/Mistral-7B-v0.3

Finetuned

mistralai/Mistral-7B-Instruct-v0.3

Quantized

(196)

this model

Collection including turboderp/Mistral-7B-Instruct-v0.3-exl3

EXL3 models

33 items • Updated 4 days ago • 38