Spaces:
Sleeping
Sleeping
Update app.py
Browse files
app.py
CHANGED
@@ -370,7 +370,7 @@ print(response["choices"][0]["text"])
|
|
370 |
## FAQ
|
371 |
|
372 |
**Q: What quantization levels are available?**
|
373 |
-
A: Common options include q4_0, q4_k_m, q5_0, q5_k_m, q8_0
|
374 |
|
375 |
**Q: How much performance loss occurs with q4_k_m?**
|
376 |
A: Typically 2-5% accuracy reduction but 4x smaller size
|
|
|
370 |
## FAQ
|
371 |
|
372 |
**Q: What quantization levels are available?**
|
373 |
+
A: Common options include q4_0, q4_k_m, q5_0, q5_k_m, q8_0
|
374 |
|
375 |
**Q: How much performance loss occurs with q4_k_m?**
|
376 |
A: Typically 2-5% accuracy reduction but 4x smaller size
|