nm-testing
/

Meta-llama3-8b-Instruct-quant-FP8

Text Generation

text-generation-inference

compressed-tensors

Model card Files Files and versions

Meta-llama3-8b-Instruct-quant-FP8

Commit History

Updated compression_config to quantization_config

6cbc172
verified

mgoin commited on Oct 9, 2024

Upload folder using huggingface_hub

e1dbda6
verified

RelaxingSnorlax commited on Jul 19, 2024

initial commit

759c1d5
verified

RelaxingSnorlax commited on Jul 19, 2024