Commit
·
e005212
1
Parent(s):
523bf99
Upload bigcode/starcoderbase ctranslate fp16 weights
Browse files- README.md +3 -3
- model.bin +2 -2
- vocab.json +0 -0
README.md
CHANGED
|
@@ -256,12 +256,12 @@ quantized version of [bigcode/starcoderbase](https://huggingface.co/bigcode/star
|
|
| 256 |
```bash
|
| 257 |
pip install hf-hub-ctranslate2>=2.0.8
|
| 258 |
```
|
| 259 |
-
Converted on 2023-05-
|
| 260 |
```
|
| 261 |
-
ct2-transformers-converter --model bigcode/starcoderbase --output_dir /home/michael/tmp-ct2fast-starcoderbase --force --copy_files merges.txt tokenizer.json README.md tokenizer_config.json generation_config.json special_tokens_map.json .gitattributes --quantization float16
|
| 262 |
```
|
| 263 |
|
| 264 |
-
Checkpoint compatible to [ctranslate2>=3.
|
| 265 |
- `compute_type=int8_float16` for `device="cuda"`
|
| 266 |
- `compute_type=int8` for `device="cpu"`
|
| 267 |
|
|
|
|
| 256 |
```bash
|
| 257 |
pip install hf-hub-ctranslate2>=2.0.8
|
| 258 |
```
|
| 259 |
+
Converted on 2023-05-30 using
|
| 260 |
```
|
| 261 |
+
ct2-transformers-converter --model bigcode/starcoderbase --output_dir /home/michael/tmp-ct2fast-starcoderbase --force --copy_files merges.txt tokenizer.json README.md tokenizer_config.json vocab.json generation_config.json special_tokens_map.json .gitattributes --quantization float16 --trust_remote_code
|
| 262 |
```
|
| 263 |
|
| 264 |
+
Checkpoint compatible to [ctranslate2>=3.14.0](https://github.com/OpenNMT/CTranslate2) and [hf-hub-ctranslate2>=2.0.8](https://github.com/michaelfeil/hf-hub-ctranslate2)
|
| 265 |
- `compute_type=int8_float16` for `device="cuda"`
|
| 266 |
- `compute_type=int8` for `device="cpu"`
|
| 267 |
|
model.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ecf40cf6f4f557172591670d1118a77533e0029b248c77dd9e7aa4fab6724eaa
|
| 3 |
+
size 31034941879
|
vocab.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|