Almheiri
/

Llama-3.2-1B-Instruct-SparseGPT-INT4

4-bit precision

Model card Files Files and versions Community

Llama-3.2-1B-Instruct-SparseGPT-INT4

1 contributor

History: 4 commits

Almheiri's picture

Upload of AutoGPTQ quantized model

ed14860 verified about 1 month ago

.gitattributes

1.57 kB

Upload folder using huggingface_hub about 1 month ago
README.md

881 Bytes

Create README.md about 1 month ago
config.json

1.3 kB

Upload of AutoGPTQ quantized model about 1 month ago
generation_config.json

184 Bytes

Upload folder using huggingface_hub about 1 month ago
gptq_model-4bit-128g.safetensors

1.56 GB
LFS

Upload of AutoGPTQ quantized model about 1 month ago
model.safetensors

2.47 GB
LFS

Upload folder using huggingface_hub about 1 month ago
quantize_config.json

264 Bytes

Upload of AutoGPTQ quantized model about 1 month ago
special_tokens_map.json

296 Bytes

Upload folder using huggingface_hub about 1 month ago
tokenizer.json

17.2 MB
LFS

Upload folder using huggingface_hub about 1 month ago
tokenizer_config.json

54.6 kB

Upload folder using huggingface_hub about 1 month ago