mpasila
/

llama-7b-finnish-instruct-v0.2-exl2-4bpw

Text Generation

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

mpasila commited on Mar 21, 2024

Commit

facba03

•

1 Parent(s): 1f5574f

Clarified quantization type

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -7,7 +7,7 @@ tags:
 inference: true
 pipeline_tag: text-generation
 ---
-This is an EXL2 quantized model in 4bpw of [Finnish-NLP/llama-7b-finnish-instruct-v0.2](https://huggingface.co/Finnish-NLP/llama-7b-finnish-instruct-v0.2) using the default calibration dataset.
 Prompt format is custom (it seems to be kinda broken):

 inference: true
 pipeline_tag: text-generation
 ---
+This is an ExLlamaV2 quantized model in 4bpw of [Finnish-NLP/llama-7b-finnish-instruct-v0.2](https://huggingface.co/Finnish-NLP/llama-7b-finnish-instruct-v0.2) using the default calibration dataset.
 Prompt format is custom (it seems to be kinda broken):