Spaces:
Sleeping
Sleeping
Update app.py
Browse files
app.py
CHANGED
@@ -240,6 +240,11 @@ def process_model(model_id, q_method, use_imatrix, imatrix_q_method, private_rep
|
|
240 |
## ✅ Quantized Models Download List
|
241 |
|
242 |
### 🔍 Recommended Quantizations
|
|
|
|
|
|
|
|
|
|
|
243 |
| 🚀 Download | 🔢 Type | 📝 Notes |
|
244 |
|:---------|:-----|:------|
|
245 |
| [Download](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-q2_k.gguf) |  | Basic quantization |
|
|
|
240 |
## ✅ Quantized Models Download List
|
241 |
|
242 |
### 🔍 Recommended Quantizations
|
243 |
+
- **✨ General CPU Use:** [`Q4_K_M`](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-q4_k_m.gguf) (Best balance of speed/quality)
|
244 |
+
- **📱 ARM Devices:** [`Q4_0`](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-q4_0.gguf) (Optimized for ARM CPUs)
|
245 |
+
- **🏆 Maximum Quality:** [`Q8_0`](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-q8_0.gguf) (Near-original quality)
|
246 |
+
|
247 |
+
### 📦 Full Quantization Options
|
248 |
| 🚀 Download | 🔢 Type | 📝 Notes |
|
249 |
|:---------|:-----|:------|
|
250 |
| [Download](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-q2_k.gguf) |  | Basic quantization |
|