nm-testing/Llama-3.1-8B-Instruct-QKV-Cache-FP8-Per-Tensor
Updated
KV Cache Quantization
Collection on FP8 Quantization of Weights, Activations and KV Cache
-
-
nm-testing/Llama-3.1-8B-Instruct-QKV-Cache-FP8-Per-Head
Updated -
nm-testing/Llama-3.1-8B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Tensor
Updated -
nm-testing/Llama-3.1-8B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Head
Updated -
nm-testing/Qwen3-32B-QKV-Cache-FP8-Per-Tensor
Updated -
nm-testing/Qwen3-32B-QKV-Cache-FP8-Per-Head
Updated -
nm-testing/Qwen3-32B-FP8-dynamic-QKV-Cache-FP8-Per-Tensor
Updated -
nm-testing/Qwen3-32B-FP8-dynamic-QKV-Cache-FP8-Per-Head
Updated -
nm-testing/Llama-3.3-70B-Instruct-QKV-Cache-FP8-Per-Tensor
Updated -
nm-testing/Llama-3.3-70B-Instruct-QKV-Cache-FP8-Per-Head
Updated -
nm-testing/Llama-3.3-70B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Tensor
Updated -
nm-testing/Llama-3.3-70B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Head
Updated