ModelCloud
/

gemma-2-9b-gptq-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Qubitium commited on Jul 2

Commit

c7fec57

•

1 Parent(s): dbfaa09

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -1,3 +1,5 @@
 - **bits**: 4
 - **group_size**: 128
 - **desc_act**: true

+--Quantized using [GPTQModel v0.9.2](https://github.com/ModelCloud/GPTQModel)
+-
 - **bits**: 4
 - **group_size**: 128
 - **desc_act**: true