ISTA-DASLab
's Collections
Extreme Compression of Large Language Models via Additive Quantization
Paper
•
2401.06118
•
Published
•
12
ISTA-DASLab/Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16
Text Generation
•
Updated
•
134
•
20
ISTA-DASLab/Meta-Llama-3-70B-AQLM-2Bit-1x16
Text Generation
•
Updated
•
39
•
14
ISTA-DASLab/Meta-Llama-3-8B-Instruct-AQLM-2Bit-1x16
Text Generation
•
Updated
•
237
•
12
ISTA-DASLab/Meta-Llama-3-8B-AQLM-2Bit-1x16
Text Generation
•
Updated
•
834
•
7
ISTA-DASLab/c4ai-command-r-v01-AQLM-2Bit-1x16
Text Generation
•
Updated
•
12
•
10
ISTA-DASLab/c4ai-command-r-plus-AQLM-2Bit-1x16
Text Generation
•
Updated
•
17
•
10
ISTA-DASLab/Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf
Text Generation
•
Updated
•
75
•
18
ISTA-DASLab/Mixtral-8x7b-AQLM-2Bit-1x16-hf
Text Generation
•
Updated
•
51
•
23
ISTA-DASLab/Mistral-7B-Instruct-v0.2-AQLM-2Bit-2x8
Text Generation
•
Updated
•
21
•
3
ISTA-DASLab/Mistral-7B-v0.1-AQLM-2Bit-1x16-hf
Text Generation
•
Updated
•
13
•
2
ISTA-DASLab/gemma-2b-AQLM-2Bit-1x16-hf
Text Generation
•
Updated
•
26
•
6
ISTA-DASLab/gemma-2b-AQLM-2Bit-2x8-hf
Text Generation
•
Updated
•
17
•
4
ISTA-DASLab/Llama-2-7b-AQLM-2Bit-1x16-hf
Text Generation
•
Updated
•
7.82k
•
5
ISTA-DASLab/Llama-2-7b-AQLM-2Bit-2x8-hf
Text Generation
•
Updated
•
39
•
2
ISTA-DASLab/Llama-2-7b-AQLM-2Bit-8x8-hf
Text Generation
•
Updated
•
28
ISTA-DASLab/Llama-2-13b-AQLM-2Bit-1x16-hf
Text Generation
•
Updated
•
24
ISTA-DASLab/Llama-2-13b-AQLM-4Bit-2x16-hf
Text Generation
•
Updated
•
12
ISTA-DASLab/Llama-2-70b-AQLM-2Bit-1x16-hf
Text Generation
•
Updated
•
11
•
6
ISTA-DASLab/Llama-2-70b-AQLM-2Bit-2x8-hf
Text Generation
•
Updated
•
34
•
1
ISTA-DASLab/Llama-2-70b-AQLM-4Bit-2x16-hf
Text Generation
•
Updated
•
8