lebe1
/

opt-125m-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

1 contributor

History: 5 commits

lebe1's picture

AutoGPTQ model for facebook/opt-125m: 4 bits

886425a over 1 year ago

.gitattributes

1.52 kB

initial commit over 1 year ago
config.json

1.45 kB

AutoGPTQ model for facebook/opt-125m: 8bits, gr128, desc_act=False over 1 year ago
generation_config.json

137 Bytes

AutoGPTQ model for facebook/opt-125m: 8bits, gr128, desc_act=False over 1 year ago
gptq_model-4bit-128g.safetensors

202 MB
LFS

AutoGPTQ model for facebook/opt-125m: 4bits, gr128, desc_act=False over 1 year ago
model.safetensors

125 MB
LFS

AutoGPTQ model for facebook/opt-125m: 8bits, gr128, desc_act=False over 1 year ago
quantize_config.json

240 Bytes

AutoGPTQ model for facebook/opt-125m: 4bits, gr128, desc_act=False over 1 year ago