parameters guide
samplers guide
model generation
role play settings
quant selection
arm quants
iq quants vs q quants
optimal model setting
gibberish fixes
coherence
instructing following
quality generation
chat settings
quality settings
llamacpp server
llamacpp
lmstudio
sillytavern
koboldcpp
backyard
ollama
model generation steering
steering
model generation fixes
text generation webui
ggufs
exl2
full precision
quants
imatrix
neo imatrix
Update README.md
Browse files
README.md
CHANGED
@@ -30,8 +30,6 @@ tags:
|
|
30 |
|
31 |
<h3>Maximizing Model Performance for All Quants Types And Full-Precision using Samplers, Advance Samplers and Parameters Guide</h3>
|
32 |
|
33 |
-
<h3>Maximizing Model Performance for All Quants Types And Full-Precision using Samplers, Advance Samplers and Parameters Guide</h3>
|
34 |
-
|
35 |
This document includes detailed information, references, and notes for general parameters, samplers and
|
36 |
advanced samplers to get the most out of your model's abilities including notes / settings for the most popular AI/LLM app in use (LLAMACPP, KoboldCPP, Text-Generation-WebUI, LMStudio, Sillytavern, Ollama and others).
|
37 |
|
@@ -80,11 +78,11 @@ You will get higher quality operation overall - stronger prose, better answers,
|
|
80 |
|
81 |
---
|
82 |
|
83 |
-
INDEX
|
84 |
|
85 |
---
|
86 |
|
87 |
-
How to Use this document
|
88 |
|
89 |
Review quant(s) information to select quant(s) to download, then review "Class 1,2,3..." for specific information on models followed by "Source Files...APPS to run LLMs/AIs". "Quick reference" will state the best parameter settings for each "Class" of model(s) to get the best operation and/or good defaults to use to get started. The detailed sections about parameters - Section 1 a,b,c and section 2 will help tune the model(s) operation.
|
90 |
|
@@ -92,6 +90,8 @@ The "DETAILED NOTES ON PARAMETERS, SAMPLERS and ADVANCED SAMPLERS" section after
|
|
92 |
|
93 |
All information about parameters, samplers and advanced samplers applies to ALL models , regardless of repo(s) you download them from.
|
94 |
|
|
|
|
|
95 |
QUANTS:
|
96 |
- QUANTS Detailed information.
|
97 |
- IMATRIX Quants
|
@@ -128,6 +128,8 @@ DETAILED NOTES ON PARAMETERS, SAMPLERS and ADVANCED SAMPLERS:
|
|
128 |
- Benchmarking-and-Guiding-Adaptive-Sampling-Decoding
|
129 |
|
130 |
ADVANCED: HOW TO TEST EACH PARAMETER(s), SAMPLER(s) and ADVANCED SAMPLER(s)
|
|
|
|
|
131 |
|
132 |
---
|
133 |
|
|
|
30 |
|
31 |
<h3>Maximizing Model Performance for All Quants Types And Full-Precision using Samplers, Advance Samplers and Parameters Guide</h3>
|
32 |
|
|
|
|
|
33 |
This document includes detailed information, references, and notes for general parameters, samplers and
|
34 |
advanced samplers to get the most out of your model's abilities including notes / settings for the most popular AI/LLM app in use (LLAMACPP, KoboldCPP, Text-Generation-WebUI, LMStudio, Sillytavern, Ollama and others).
|
35 |
|
|
|
78 |
|
79 |
---
|
80 |
|
81 |
+
<H2>INDEX</H2>
|
82 |
|
83 |
---
|
84 |
|
85 |
+
<B>How to Use this document:</B>
|
86 |
|
87 |
Review quant(s) information to select quant(s) to download, then review "Class 1,2,3..." for specific information on models followed by "Source Files...APPS to run LLMs/AIs". "Quick reference" will state the best parameter settings for each "Class" of model(s) to get the best operation and/or good defaults to use to get started. The detailed sections about parameters - Section 1 a,b,c and section 2 will help tune the model(s) operation.
|
88 |
|
|
|
90 |
|
91 |
All information about parameters, samplers and advanced samplers applies to ALL models , regardless of repo(s) you download them from.
|
92 |
|
93 |
+
<small>
|
94 |
+
<PRE>
|
95 |
QUANTS:
|
96 |
- QUANTS Detailed information.
|
97 |
- IMATRIX Quants
|
|
|
128 |
- Benchmarking-and-Guiding-Adaptive-Sampling-Decoding
|
129 |
|
130 |
ADVANCED: HOW TO TEST EACH PARAMETER(s), SAMPLER(s) and ADVANCED SAMPLER(s)
|
131 |
+
</pre>
|
132 |
+
</small>
|
133 |
|
134 |
---
|
135 |
|