danieldk
/

Llama-3.1-8B-w4a16-int-24

compressed-tensors

Model card Files Files and versions Community

Llama-3.1-8B-w4a16-int-24

1 contributor

History: 3 commits

danieldk's picture

danieldk HF staff

Create README.md

85cadcd verified about 1 month ago

.gitattributes

1.57 kB

Add nm-testing/Llama-3_1-8B_2of4_w4a16_gsm8k_256_8196_damp0_1_mse_llm_compressor about 1 month ago
README.md

337 Bytes

Create README.md about 1 month ago
config.json

1.99 kB

Add nm-testing/Llama-3_1-8B_2of4_w4a16_gsm8k_256_8196_damp0_1_mse_llm_compressor about 1 month ago
generation_config.json

180 Bytes

Add nm-testing/Llama-3_1-8B_2of4_w4a16_gsm8k_256_8196_damp0_1_mse_llm_compressor about 1 month ago
model.safetensors

4.83 GB
LFS

Add nm-testing/Llama-3_1-8B_2of4_w4a16_gsm8k_256_8196_damp0_1_mse_llm_compressor about 1 month ago
recipe.yaml

318 Bytes

Add nm-testing/Llama-3_1-8B_2of4_w4a16_gsm8k_256_8196_damp0_1_mse_llm_compressor about 1 month ago
special_tokens_map.json

449 Bytes

Add nm-testing/Llama-3_1-8B_2of4_w4a16_gsm8k_256_8196_damp0_1_mse_llm_compressor about 1 month ago
tokenizer.json

17.2 MB
LFS

Add nm-testing/Llama-3_1-8B_2of4_w4a16_gsm8k_256_8196_damp0_1_mse_llm_compressor about 1 month ago
tokenizer_config.json

50.5 kB

Add nm-testing/Llama-3_1-8B_2of4_w4a16_gsm8k_256_8196_damp0_1_mse_llm_compressor about 1 month ago