michaelfeil
commited on
Commit
·
71be13b
1
Parent(s):
c0b1804
Upload bigcode/gpt_bigcode-santacoder ctranslate fp16 weights
Browse files
README.md
CHANGED
@@ -175,12 +175,12 @@ quantized version of [bigcode/gpt_bigcode-santacoder](https://huggingface.co/big
|
|
175 |
```bash
|
176 |
pip install hf-hub-ctranslate2>=2.0.8
|
177 |
```
|
178 |
-
Converted on 2023-05-
|
179 |
```
|
180 |
-
ct2-transformers-converter --model bigcode/gpt_bigcode-santacoder --output_dir /home/michael/tmp-ct2fast-gpt_bigcode-santacoder --force --copy_files tokenizer.json README.md tokenizer_config.json special_tokens_map.json .gitattributes --quantization float16
|
181 |
```
|
182 |
|
183 |
-
Checkpoint compatible to [ctranslate2>=3.
|
184 |
- `compute_type=int8_float16` for `device="cuda"`
|
185 |
- `compute_type=int8` for `device="cpu"`
|
186 |
|
|
|
175 |
```bash
|
176 |
pip install hf-hub-ctranslate2>=2.0.8
|
177 |
```
|
178 |
+
Converted on 2023-05-30 using
|
179 |
```
|
180 |
+
ct2-transformers-converter --model bigcode/gpt_bigcode-santacoder --output_dir /home/michael/tmp-ct2fast-gpt_bigcode-santacoder --force --copy_files tokenizer.json README.md tokenizer_config.json special_tokens_map.json .gitattributes --quantization float16 --trust_remote_code
|
181 |
```
|
182 |
|
183 |
+
Checkpoint compatible to [ctranslate2>=3.14.0](https://github.com/OpenNMT/CTranslate2) and [hf-hub-ctranslate2>=2.0.8](https://github.com/michaelfeil/hf-hub-ctranslate2)
|
184 |
- `compute_type=int8_float16` for `device="cuda"`
|
185 |
- `compute_type=int8` for `device="cpu"`
|
186 |
|
model.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:bac5238e13ffa2f32eed45308d2735d95534de0141961e5be2e2a2f0bfae57d9
|
3 |
+
size 2249790695
|