HF-Quantization/Llama-3.3-70B-Instruct-TORCHAO-W8
Updated
HF Quantization
community
AI & ML interests
Making AI models smaller, and faster with Quantization
Recent Activity
View all activity
HF-Quantization
's models
11
HF-Quantization/Llama-3.3-70B-Instruct-TORCHAO-W4
Updated
•
30
HF-Quantization/Llama-3.2-1B-BNB-INT8
Updated
•
8
HF-Quantization/Llama-3.2-1B-BNB-NF4
Updated
•
30
HF-Quantization/Llama-3.2-1B-BNB-FP4
Updated
•
45
HF-Quantization/Llama-3.2-1B-BNB-NF4-BF16
Updated
•
11
HF-Quantization/Llama-3.2-1B-BNB-FP4-BF16
Updated
•
19
HF-Quantization/Llama-3.2-1B-TORCHAO-W8A8
Updated
•
71
HF-Quantization/Llama-3.2-1B-TORCHAO-W8
Updated
•
10
HF-Quantization/Llama-3.2-1B-TORCHAO-W4
Updated
•
12
HF-Quantization/Llama-3.2-1B-GPTQ-INT4
Updated
•
9