Hugging Face's logo

VPTQ-community
/
Meta-Llama-3.1-405B-Instruct-v16-k32768-32768-woft

Safetensors
llama
VPTQ
Quantized
Quantization
Model card Files Community
OpenSourceRonin commited on
Commit
06a3d25
•
1 Parent(s): 162709a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -2,7 +2,11 @@
2
  license: llama3.1
3
  base_model:
4
  - meta-llama/Llama-3.1-405B-Instruct
 
 
 
5
  ---
 
6
  **Disclaimer**:
7
 
8
  The model is reproduced based on the paper *VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models* [github](https://github.com/microsoft/vptq) and [arXiv](https://arxiv.org/abs/2409.17066)
 
2
  license: llama3.1
3
  base_model:
4
  - meta-llama/Llama-3.1-405B-Instruct
5
+ tags:
6
+ - VPTQ
7
+ - Quantization
8
  ---
9
+
10
  **Disclaimer**:
11
 
12
  The model is reproduced based on the paper *VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models* [github](https://github.com/microsoft/vptq) and [arXiv](https://arxiv.org/abs/2409.17066)