Whisper Quantized - a RedHatAI Collection

RedHatAI 's Collections

Red Hat AI validated models - October 2025

Red Hat AI validated models - September 2025

Speculator Models

Red Hat AI validated models - May 2025

Gemma-3 Quantized

Whisper Quantized

Llama 4 Quantized

Qwen3 Quantized

Mistral-Small-3.1 (2503) Instruct Quantized

Phi-4 Quantized

Llama 3.3 70B Instruct Quantized

Qwen 2.5 Quantized

Granite Quantized

Whisper Quantized

updated 20 days ago

Collection of quantized whisper models created by OpenAI

RedHatAI/whisper-large-v3-turbo-quantized.w4a16

Automatic Speech Recognition • 0.2B • Updated 21 days ago • 228 • 6
RedHatAI/whisper-large-v3-turbo-quantized.w8a8

Automatic Speech Recognition • 0.9B • Updated Apr 22 • 32 • 4
RedHatAI/whisper-large-v3-turbo-FP8-dynamic

Automatic Speech Recognition • 0.9B • Updated Apr 22 • 451 • 5
RedHatAI/whisper-tiny-FP8-Dynamic

Automatic Speech Recognition • 57.8M • Updated Apr 22
RedHatAI/whisper-large-v2-W4A16-G128

Automatic Speech Recognition • 0.3B • Updated Jan 31 • 1 • 1
RedHatAI/whisper-large-v2-quantized.w4a16

Automatic Speech Recognition • 0.3B • Updated Apr 22 • 3 • 1
RedHatAI/whisper-tiny-quantized.w8a8

Automatic Speech Recognition • 57.8M • Updated Apr 22
RedHatAI/whisper-large-v2-quantized.w8a8

Automatic Speech Recognition • 2B • Updated Apr 22 • 7
RedHatAI/whisper-medium-FP8-dynamic

Automatic Speech Recognition • 0.8B • Updated Apr 22
RedHatAI/whisper-small-FP8-Dynamic

Automatic Speech Recognition • 0.3B • Updated Apr 22 • 39
RedHatAI/whisper-small-quantized.w4a16

Automatic Speech Recognition • 77M • Updated Apr 22 • 5 • 1
RedHatAI/whisper-small-quantized.w8a8

Automatic Speech Recognition • 0.3B • Updated Apr 22 • 9
RedHatAI/whisper-large-v2-FP8-Dynamic

Automatic Speech Recognition • 2B • Updated Apr 22 • 200
RedHatAI/whisper-large-v3-FP8-dynamic

Automatic Speech Recognition • 2B • Updated Apr 22 • 388 • 2
RedHatAI/whisper-large-v3-quantized.w4a16

Automatic Speech Recognition • 0.3B • Updated Apr 22 • 357 • 3
RedHatAI/whisper-large-v3-quantized.w8a8

Automatic Speech Recognition • 2B • Updated Apr 22 • 292 • 1
RedHatAI/whisper-medium-quantized.w4a16

Automatic Speech Recognition • 0.2B • Updated Apr 22
RedHatAI/whisper-medium-quantized.w8a8

Automatic Speech Recognition • 0.8B • Updated Apr 22 • 4
RedHatAI/whisper-tiny-quantized.w4a16

Updated Apr 1