matrixportal commited on
Commit
522adf4
·
verified ·
1 Parent(s): 5af094f

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +1 -1
app.py CHANGED
@@ -370,7 +370,7 @@ print(response["choices"][0]["text"])
370
  ## FAQ
371
 
372
  **Q: What quantization levels are available?**
373
- A: Common options include q4_0, q4_k_m, q5_0, q5_k_m, q8_0 (my script uses q4_k_m by default)
374
 
375
  **Q: How much performance loss occurs with q4_k_m?**
376
  A: Typically 2-5% accuracy reduction but 4x smaller size
 
370
  ## FAQ
371
 
372
  **Q: What quantization levels are available?**
373
+ A: Common options include q4_0, q4_k_m, q5_0, q5_k_m, q8_0
374
 
375
  **Q: How much performance loss occurs with q4_k_m?**
376
  A: Typically 2-5% accuracy reduction but 4x smaller size