RedHatAI/Mixtral-8x7B-Instruct-v0.1-FP8
47B
•
Updated
•
890
RedHatAI/Phi-4-mini-instruct-quantized.w8a8
4B
•
Updated
•
4
RedHatAI/Phi-4-mini-instruct-FP8-dynamic
4B
•
Updated
•
3
RedHatAI/Mixtral-8x7B-v0.1-quantized.w4a16
6B
•
Updated
•
1
RedHatAI/granite-3.1-2b-base-quantized.w4a16
Text Generation
•
0.5B
•
Updated
•
5
RedHatAI/granite-3.1-2b-base-quantized.w8a8
Text Generation
•
3B
•
Updated
•
12
RedHatAI/granite-3.1-8b-base-quantized.w8a8
Text Generation
•
8B
•
Updated
•
4
RedHatAI/granite-3.1-2b-instruct-quantized.w8a8
Text Generation
•
3B
•
Updated
•
3
RedHatAI/granite-3.1-2b-instruct-quantized.w4a16
Text Generation
•
0.5B
•
Updated
•
54
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a16
Text Generation
•
0.6B
•
Updated
•
5
•
1
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w8a8
Text Generation
•
2B
•
Updated
•
5.07k
•
2
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-FP8-dynamic
Text Generation
•
2B
•
Updated
•
55
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16
Text Generation
•
2B
•
Updated
•
466
•
2
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8
Text Generation
•
8B
•
Updated
•
4.55k
•
5
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-FP8-dynamic
Text Generation
•
8B
•
Updated
•
1.27k
•
1
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16
Text Generation
•
3B
•
Updated
•
167
•
1
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w8a8
Text Generation
•
15B
•
Updated
•
3k
•
2
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-FP8-dynamic
Text Generation
•
15B
•
Updated
•
1.3k
•
3
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16
Text Generation
•
6B
•
Updated
•
24.5k
•
5
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8
Text Generation
•
33B
•
Updated
•
4.36k
•
13
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-FP8-dynamic
Text Generation
•
33B
•
Updated
•
2.06k
•
9
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16
Text Generation
•
11B
•
Updated
•
382
•
5
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8
Text Generation
•
71B
•
Updated
•
220
•
2
RedHatAI/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic
Text Generation
•
71B
•
Updated
•
2.48k
•
10
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w4a16
Text Generation
•
2B
•
Updated
•
520
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w8a8
Text Generation
•
8B
•
Updated
•
56.5k
•
2
RedHatAI/DeepSeek-R1-Distill-Llama-8B-FP8-dynamic
Text Generation
•
8B
•
Updated
•
145
•
5
RedHatAI/pixtral-12b-quantized.w4a16
Image-to-Text
•
3B
•
Updated
•
91
•
1
RedHatAI/Mixtral-8x22B-Instruct-v0.1-FP8
141B
•
Updated
•
89
RedHatAI/pixtral-12b-quantized.w8a8
Image-to-Text
•
13B
•
Updated
•
1
•
1