xverse
/

XVERSE-7B-Chat-GPTQ-Int4

Text Generation

4-bit precision

Model card Files Files and versions Community

willhe-xverse commited on Mar 25

Commit

75872ca

•

1 Parent(s): 6bf9b72

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -67,7 +67,7 @@ for output in outputs:
 ## Usage
-We demonstrated how to use 'vllm' to run the XVERSE-7B-Chat GPTQ Int4 quantization model:
 ```python
 from vllm import LLM, SamplingParams

 ## Usage
+We demonstrated how to use 'vllm' to run the XVERSE-7B-Chat-GPTQ-Int4 quantization model:
 ```python
 from vllm import LLM, SamplingParams