Update README.md
Browse files
README.md
CHANGED
|
@@ -18,13 +18,13 @@ Model type: [Text to SQL]
|
|
| 18 |
License: [CC-by-SA-4.0]
|
| 19 |
Finetuned from model: [Meta-Llama-3-8B-Instruct]
|
| 20 |
|
| 21 |
-
##
|
| 22 |
|
| 23 |
**The model is quantized version of the [defog/llama-3-sqlcoder-8b](https://huggingface.co/defog/llama-3-sqlcoder-8b) with int8_float16 quantization and can be used in [CTranslate2](https://github.com/OpenNMT/CTranslate2).**
|
| 24 |
|
| 25 |
## Conversion details
|
| 26 |
|
| 27 |
-
The original model was converted on 2024-
|
| 28 |
```
|
| 29 |
ct2-transformers-converter --model Path\To\Local\meta-llama\Meta-Llama-3-8B-Instruct \
|
| 30 |
--quantization int8_float16 --output_dir Meta-Llama-3-8B-Instruct-ct2-int8_float16
|
|
|
|
| 18 |
License: [CC-by-SA-4.0]
|
| 19 |
Finetuned from model: [Meta-Llama-3-8B-Instruct]
|
| 20 |
|
| 21 |
+
## defog/llama-3-sqlcoder-8b for CTranslate2
|
| 22 |
|
| 23 |
**The model is quantized version of the [defog/llama-3-sqlcoder-8b](https://huggingface.co/defog/llama-3-sqlcoder-8b) with int8_float16 quantization and can be used in [CTranslate2](https://github.com/OpenNMT/CTranslate2).**
|
| 24 |
|
| 25 |
## Conversion details
|
| 26 |
|
| 27 |
+
The original model was converted on 2024-06 with the following command:
|
| 28 |
```
|
| 29 |
ct2-transformers-converter --model Path\To\Local\meta-llama\Meta-Llama-3-8B-Instruct \
|
| 30 |
--quantization int8_float16 --output_dir Meta-Llama-3-8B-Instruct-ct2-int8_float16
|