jitsi
/

Llama-3.1-8B-Instruct-W8A8-Dynamic-Per-Token

8-bit precision

compressed-tensors

Model card Files Files and versions Community

Llama-3.1-8B-Instruct-W8A8-Dynamic-Per-Token

1 contributor

History: 3 commits

quitrk's picture

Update with model quantized using llmcompressor 0.3.0

7ad6bbe verified about 1 month ago

.gitattributes

1.57 kB

Upload quantized INT8 llama 3.1-8b-instruct model about 1 month ago
README.md

29 Bytes

initial commit about 1 month ago
config.json

2.01 kB

Upload quantized INT8 llama 3.1-8b-instruct model about 1 month ago
generation_config.json

184 Bytes

Upload quantized INT8 llama 3.1-8b-instruct model about 1 month ago
model-00001-of-00002.safetensors

5 GB
LFS

Update with model quantized using llmcompressor 0.3.0 about 1 month ago
model-00002-of-00002.safetensors

4.08 GB
LFS

Update with model quantized using llmcompressor 0.3.0 about 1 month ago
model.safetensors.index.json

43.5 kB

Upload quantized INT8 llama 3.1-8b-instruct model about 1 month ago
special_tokens_map.json

296 Bytes

Upload quantized INT8 llama 3.1-8b-instruct model about 1 month ago
tokenizer.json

17.2 MB
LFS

Update with model quantized using llmcompressor 0.3.0 about 1 month ago
tokenizer_config.json

55.3 kB

Upload quantized INT8 llama 3.1-8b-instruct model about 1 month ago