Quantized model (not only codec)
#1
by
DoS007
- opened
It's nice that you provide a quantized version (the only for s1-mini?). Did you try to quantize the model as well to e.g. q4_k_m (and not only the codec)?
the codec is the major part of the model; the file model is kind of clip, if you quantize it, the quantized tensor won't work
ok, thanks for clearing that up