Update README.md
Browse files
README.md
CHANGED
@@ -18,9 +18,7 @@ pipeline_tag: text-generation
|
|
18 |
|
19 |
# Q Model: Optimized for Enhanced Quantized Inference Capability
|
20 |
|
21 |
-
This model has been optimized specifically for enhancing the quantized inference capability. It is designed to be
|
22 |
-
|
23 |
-
If your requirements involve a model that is suitable for full-scale inference, we recommend referring to our version that does not include the "q" suffix.
|
24 |
|
25 |
# OpenBuddy - Open Multilingual Chatbot
|
26 |
|
|
|
18 |
|
19 |
# Q Model: Optimized for Enhanced Quantized Inference Capability
|
20 |
|
21 |
+
This model has been optimized specifically for enhancing the quantized inference capability. It is designed to be deployed after being quantized to 2-4 bits.
|
|
|
|
|
22 |
|
23 |
# OpenBuddy - Open Multilingual Chatbot
|
24 |
|