RKLLM Runtime 1.1.4
Collection
Model collections converted with RKLLM Runtime 1.1.4, requieres NPU Driver version 0.9.8
•
3 items
•
Updated
Llama 3.2 1B for RK3588
This is a conversion from https://huggingface.co/meta-llama/Meta-Llama-3.2-1B to the RKLLM format for Rockchip devices. Target conversion to be running on the RK3588 NPU.
RKLLM runtime 1.1.1 requires NPU driver 0.9.6:
RKLLM runtime 1.1.4 requires NPU driver 0.9.8:
License
Same as the original LLM:
https://huggingface.co/meta-llama/Meta-Llama-3.2-1B/blob/main/LICENSE.txt
- Downloads last month
- -
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support