Models

RedHatAI/Voxtral-Mini-3B-2507-FP8-dynamic

Automatic Speech Recognition • 5B • Updated 21 days ago • 459 • 8

scb10x/typhoon2.1-gemma3-12b-fp8

Text Generation • 13B • Updated Aug 31 • 312 • 1

tencent/Hunyuan-MT-7B-fp8

Translation • 8B • Updated Sep 2 • 13.8k • 26

cpatonn/Qwen3-Next-80B-A3B-Thinking-AWQ-4bit

Text Generation • Updated Sep 20 • 23.6k • 14

cpatonn/Tongyi-DeepResearch-30B-A3B-AWQ-8bit

9B • Updated Sep 18 • 76 • 3

cpatonn/Qwen3-Next-80B-A3B-Thinking-AWQ-8bit

Text Generation • Updated Sep 23 • 307 • 1

Sunbird/Sunflower-14B-FP4A16

Text Generation • 9B • Updated 26 days ago • 12 • 1

inclusionAI/Ring-mini-linear-2.0-GPTQ-int4

Text Generation • 3B • Updated 12 days ago • 353 • 9

cpatonn/Qwen3-VL-30B-A3B-Instruct-AWQ-4bit

6B • Updated 29 days ago • 6.85k • 4

cpatonn/Qwen3-VL-30B-A3B-Instruct-AWQ-8bit

10B • Updated 28 days ago • 1.47k • 4

RESMP-DEV/GLM-4.6-NVFP4

Text Generation • Updated 26 days ago • 715 • 3

cpatonn/KAT-Dev-72B-Exp-AWQ-8bit

22B • Updated 24 days ago • 25 • 1

cpatonn/granite-4.0-h-tiny-AWQ-4bit

Text Generation • 2B • Updated 22 days ago • 553 • 1

cpatonn/Qwen3-VL-8B-Instruct-AWQ-4bit

Image-Text-to-Text • 3B • Updated 21 days ago • 6.46k • 2

ibm-granite/granite-3.3-8b-instruct-FP8

Text Generation • 8B • Updated 18 days ago • 778 • 2

mispeech/midashenglm-7b-1021-fp8

Audio-Text-to-Text • 8B • Updated 4 days ago • 39 • 1

KsuserKqy/DeepSeek-R1-Distill-Qwen-7B-AWQ-INT4

2B • Updated 14 days ago • 44 • 1

Firworks/Hermes-4-70B-nvfp4

41B • Updated 9 days ago • 8 • 1

cerebras/GLM-4.5-Air-REAP-82B-A12B-FP8

Text Generation • 82B • Updated 8 days ago • 736 • 2

ig1/Qwen3-VL-30B-A3B-Instruct-NVFP4

Image-Text-to-Text • 18B • Updated 7 days ago • 99 • 1

hell0ks/Huihui-Qwen3-VL-32B-Instruct-abliterated-W4A16

Text Generation • 6B • Updated 4 days ago • 11 • 1

Firworks/Kimi-Linear-48B-A3B-Instruct-nvfp4

28B • Updated 3 days ago • 78 • 1

Firworks/GLM-4.5-Air-REAP-82B-A12B-nvfp4

47B • Updated 1 day ago • 189 • 1

xiezhe24/ChatTS-8B-GPTQ-Int4

Text Generation • 2B • Updated about 2 hours ago • 1

nm-testing/tinyllama-one-shot-static-quant-test-compressed

Text Generation • 1B • Updated Oct 9, 2024 • 1

nm-testing/tinyllama-one-shot-dynamic-test

Text Generation • 1B • Updated Oct 9, 2024 • 2

nm-testing/tinyllama-one-shot-w4a16-group-packed

Text Generation • 0.3B • Updated Oct 10, 2024 • 1

nm-testing/tinyllama-one-shot-w4a16-channel-compressed

Text Generation • 1B • Updated Oct 9, 2024

nm-testing/tinyllama-one-shot-w4a16-channel-packed

Text Generation • 0.3B • Updated Oct 9, 2024 • 2

nm-testing/llama7b-one-shot-2_4-w4a16-packed

Text Generation • 1B • Updated Oct 9, 2024 • 1