DeepSeek-V3 architecture with 4 layers + 8 experts per MoE + MTP module + FP8 weights from original model without further tuning

To be used in CI testing

Downloads last month
31,201
Safetensors
Model size
7B params
Tensor type
F32
·
BF16
·
F8_E4M3
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support