mradermacher

/

model_requests

like 115

It's queued! :D

You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#haruhi-qwen8b-roleplaying-GGUF for quants to appear.

Because booth of the above links are currently down check the following instead:
Static quants: https://huggingface.co/mradermacher/haruhi-qwen8b-roleplaying-GGUF
Weighted/imatrix quants: https://huggingface.co/mradermacher/haruhi-qwen8b-roleplaying-i1-GGUF

@nicoboss , the last two links do not work.

Indeed, because neither transformers nor llama.cpp support the model architecture.