matrixportal commited on
Commit
9cace94
·
verified ·
1 Parent(s): 522adf4

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +5 -0
app.py CHANGED
@@ -240,6 +240,11 @@ def process_model(model_id, q_method, use_imatrix, imatrix_q_method, private_rep
240
  ## ✅ Quantized Models Download List
241
 
242
  ### 🔍 Recommended Quantizations
 
 
 
 
 
243
  | 🚀 Download | 🔢 Type | 📝 Notes |
244
  |:---------|:-----|:------|
245
  | [Download](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-q2_k.gguf) | ![Q2_K](https://img.shields.io/badge/Q2_K-1A73E8) | Basic quantization |
 
240
  ## ✅ Quantized Models Download List
241
 
242
  ### 🔍 Recommended Quantizations
243
+ - **✨ General CPU Use:** [`Q4_K_M`](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-q4_k_m.gguf) (Best balance of speed/quality)
244
+ - **📱 ARM Devices:** [`Q4_0`](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-q4_0.gguf) (Optimized for ARM CPUs)
245
+ - **🏆 Maximum Quality:** [`Q8_0`](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-q8_0.gguf) (Near-original quality)
246
+
247
+ ### 📦 Full Quantization Options
248
  | 🚀 Download | 🔢 Type | 📝 Notes |
249
  |:---------|:-----|:------|
250
  | [Download](https://huggingface.co/{new_repo_id}/resolve/main/{model_name.lower()}-q2_k.gguf) | ![Q2_K](https://img.shields.io/badge/Q2_K-1A73E8) | Basic quantization |