iproskurina
/

opt-125m-gptq2

Text Generation

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

1 contributor

History: 2 commits

iproskurina's picture

AutoGPTQ model for facebook/opt-125m: 4 bits, gr128, desc_act=False

186b371 verified 19 days ago

.gitattributes

1.52 kB

initial commit 19 days ago
config.json

1.14 kB

AutoGPTQ model for facebook/opt-125m: 4 bits, gr128, desc_act=False 19 days ago
gptq_model-4bit-128g.safetensors

202 MB
LFS

AutoGPTQ model for facebook/opt-125m: 4 bits, gr128, desc_act=False 19 days ago
quantize_config.json

297 Bytes

AutoGPTQ model for facebook/opt-125m: 4 bits, gr128, desc_act=False 19 days ago