BSC-LT
/

salamandra-2b-base-gptq

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

🇪🇺 Region: EU

Model card Files Files and versions Community

ferran-espuna commited on 9 days ago

Commit

170a44f

•

1 Parent(s): 70e5ace

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -69,7 +69,7 @@ any current version of the libraries. This is an example of how to create a text
 ```
 from vllm import LLM, SamplingParams
-model_name = "BSC-LT/salamandra-2b-base-fp8"
 llm = LLM(model=model_name)
 outputs = llm.generate("El mercat del barri ",

 ```
 from vllm import LLM, SamplingParams
+model_name = "BSC-LT/salamandra-2b-base-gptq"
 llm = LLM(model=model_name)
 outputs = llm.generate("El mercat del barri ",