NM Testing

company

AI & ML interests

None defined yet.

Recent Activity

dsikka updated a model 6 days ago

nm-testing/Qwen3-30B-A3B-NVFP416

dsikka published a model 6 days ago

nm-testing/Qwen3-30B-A3B-NVFP416

kylesayrs updated a model 6 days ago

nm-testing/gpt-oss-20b-w4a8-channelwise

View all activity

nm-testing 's models 501

nm-testing/tinyllama-fp8-dynamic-compressed

1B • Updated Oct 9, 2024 • 407

nm-testing/SmolLM-1.7B-Instruct-quantized.w4a16

Text Generation • 0.4B • Updated Oct 9, 2024 • 11

nm-testing/SmolLM-360M-Instruct-quantized.w4a16

0.1B • Updated Oct 9, 2024 • 6

nm-testing/SmolLM-135M-Instruct-quantized.w4a16

Text Generation • 71.6M • Updated Oct 9, 2024 • 10

nm-testing/Mixtral-8x7B-Instruct-v0.1-W4A16-channel-quantized

6B • Updated Oct 9, 2024 • 649

nm-testing/Meta-Llama-3-8B-Instruct-fp8-compressed

8B • Updated Oct 9, 2024 • 8

nm-testing/Phi-3-mini-128k-instruct-FP8

4B • Updated Oct 9, 2024 • 855

nm-testing/Mixtral-8x7B-Instruct-v0.1-FP8-quantized

47B • Updated Oct 9, 2024 • 9

nm-testing/Mixtral-8x7B-Instruct-v0.1-W8A16-quantized

12B • Updated Oct 9, 2024 • 642

nm-testing/Mixtral-8x7B-Instruct-v0.1-W4A16-quantized

6B • Updated Oct 9, 2024 • 637

nm-testing/tinyllama-oneshot-w8a8-dynamic-token-v2-asym

Text Generation • 1B • Updated Oct 9, 2024 • 22

nm-testing/Qwen2-1.5B-Instruct-FP8W8

Text Generation • 2B • Updated Oct 9, 2024 • 10

nm-testing/Meta-Llama-3-8B-Instruct-W4A16-ACTORDER-compressed-tensors-test

Text Generation • 2B • Updated Oct 9, 2024 • 8

nm-testing/Meta-llama3-8b-Instruct-quant-FP8

Text Generation • 8B • Updated Oct 9, 2024 • 14

nm-testing/Meta-llama3-8b-Instruct-SmoothQuant-Fp8

Text Generation • 8B • Updated Oct 9, 2024 • 12

nm-testing/Meta-Llama-3-8B-Instruct-nonuniform-test

Text Generation • 8B • Updated Oct 9, 2024 • 10.5k

nm-testing/nonuniform

Text Generation • 8B • Updated Oct 9, 2024 • 9

nm-testing/Meta-Llama-3-8B-Instruct-Non-Uniform-compressed-tensors

Text Generation • 8B • Updated Oct 9, 2024 • 10

nm-testing/Meta-Llama-3-8B-Instruct-W8A8-FP8-Channelwise-compressed-tensors

Text Generation • 8B • Updated Oct 9, 2024 • 18 • 2

nm-testing/Meta-Llama-3-8B-Instruct-FP8-K-V

Text Generation • 8B • Updated Oct 9, 2024 • 26

nm-testing/Qwen2-0.5B-Instruct

Text Generation • 0.6B • Updated Oct 9, 2024 • 12

nm-testing/Meta-Llama-3-8B-Instruct-W4A16-compressed-tensors-test

Text Generation • 2B • Updated Oct 9, 2024 • 12

nm-testing/TinyLlama-1.1B-compressed-tensors-kv-cache-scheme

Text Generation • 0.4B • Updated Oct 9, 2024 • 2.46k

nm-testing/Meta-Llama-3-8B-FP8-compressed-tensors-test-bos

Text Generation • 8B • Updated Oct 9, 2024 • 9

nm-testing/Meta-Llama-3-8B-FP8-compressed-tensors-test

Text Generation • 8B • Updated Oct 9, 2024 • 3.29k

nm-testing/Meta-Llama-3-8B-Instruct-W4-Group128-A16-Test

Text Generation • 2B • Updated Oct 9, 2024 • 8

nm-testing/Meta-Llama-3-8B-Instruct-W8-Channel-A8-Dynamic-Per-Token-Test

Text Generation • 8B • Updated Oct 9, 2024 • 80

nm-testing/tinyllama-oneshot-w8a16-per-channel

Text Generation • 0.4B • Updated Oct 9, 2024 • 647

nm-testing/Meta-Llama-3-8B-Instruct-W8A8-Dyn-Per-Token-2048-Samples

Text Generation • 8B • Updated Oct 9, 2024 • 11

nm-testing/Meta-Llama-3-8B-Instruct-W8A8-Dyn-Per-Token

Text Generation • 8B • Updated Oct 9, 2024 • 7