jamescallander
/

deepseek-coder-6.7b-instruct_w8a8_g128_rk3588.rkllm

Text Generation

Model card Files Files and versions

jamescallander commited on Sep 19

Commit

a5715d3

·

verified ·

1 Parent(s): ec2b3da

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -50,7 +50,7 @@ tags:
 ## Limitations
-- Requires 9GB free memory
 - Quantized build (`w8a8_g128`) may show small quality differences vs. full-precision upstream.
 - Tested on Radxa Rock 5B+; other devices may require different drivers/toolkit versions.
 - Generated code should always be reviewed before use in production systems.

 ## Limitations
+- Requires 9.1GB free memory
 - Quantized build (`w8a8_g128`) may show small quality differences vs. full-precision upstream.
 - Tested on Radxa Rock 5B+; other devices may require different drivers/toolkit versions.
 - Generated code should always be reviewed before use in production systems.