Update README.md

README.md

@@ -17,7 +17,7 @@ tags:
 <h3>Maximizing Model Performance for All Quants Types And Full-Precision using Samplers, Advance Samplers and Parameters Guide</h3>
 
 This document includes detailed information, references, and notes for general parameters, samplers and
-advanced samplers to get the most out of your model's abilities including notes / settings for the most popular AI/LLM app in use.
+advanced samplers to get the most out of your model's abilities including notes / settings for the most popular AI/LLM app in use (LLAMACPP, KoboldCPP, Text-Generation-WebUI, LMStudio, Sillytavern, Ollama and others).
 
 These settings / suggestions can be applied to all models including GGUF, EXL2, GPTQ, HQQ, AWQ and full source/precision.
 
@@ -40,13 +40,13 @@ The settings discussed in this document can also fix a number of model issues (<
 
 Likewise ALL the setting (parameters, samplers and advanced samplers) below can also improve model generation and/or general overall "smoothness" / "quality" of model operation:
 
-- all parameters and samplers available via LLAMACPP (and most apps that run / use LLAMACPP)
+- all parameters and samplers available via LLAMACPP (and most apps that run / use LLAMACPP - including Lmstudio, Ollama, Sillytavern and others.)
 - all parameters (including some not in Lllamacpp), samplers and advanced samplers ("Dry", "Quadratic", "Microstat") in oobabooga/text-generation-webui including llamacpp_HF loader (allowing a lot more samplers)
-- all parameters (including some not in Lllamacpp), samplers and advanced samplers ("Dry", "Quadratic", "Microstat") in KoboldCPP (including Anti-slop filters)
+- all parameters (including some not in Lllamacpp), samplers and advanced samplers ("Dry", "Quadratic", "Microstat") in SillyTavern / KoboldCPP (including Anti-slop filters)
 
-Even if you are not using my models, you may find this document useful for any model (any quant / full source) available online.
+Even if you are not using my models, you may find this document <u>useful for any model (any quant / full source / any repo) available online.</u>
 
-If you are currently using model(s) that are difficult to "wrangle" then apply "Class 3" or "Class 4" settings to them.
+If you are currently using model(s) - from my repo and/or others - that are difficult to "wrangle" then you can apply "Class 3" or "Class 4" settings to them.
 
 This document will be updated over time too and is subject to change without notice.
 
@@ -90,7 +90,7 @@ I do not set any other settings, parameters or have samplers activated when gene
 
 Everything else is "zeroed" / "disabled".
 
-These parameters/settings are considered both safe and default and in most cases available to all users in all apps.
+These parameters/settings are considered both safe and default and in most cases available to all users in all AI/LLM apps.
 
 ---
 
@@ -106,7 +106,7 @@ You will need the config files to use "llamacpp_HF" loader ("text-generation-web
 
 You can also use the full source in "text-generation-webui" too.
 
-As an alternative you can use GGUFs directly in "KOBOLDCPP" without the "config files" and still use almost all the parameters, samplers and advanced samplers.
+As an alternative you can use GGUFs directly in "KOBOLDCPP" / "SillyTavern" without the "config files" and still use almost all the parameters, samplers and advanced samplers.
 
 <B>Parameters, Samplers and Advanced Samplers</B>
 
@@ -143,7 +143,9 @@ For CLASS3 and CLASS4 the most important setting is "SMOOTHING FACTOR" (Quadrati
 
 https://docs.sillytavern.app/usage/common-settings/
 
-NOTE: It appears that Silly Tavern also supports "DRY" and "XTC" too ; but it is not yet in the documentation at the time of writing.
+NOTE: 
+
+It appears that Silly Tavern also supports "DRY" and "XTC" too ; but it is not yet in the documentation at the time of writing.
 
 You may also want to check out how to connect SillyTavern to local AI "apps" running on your pc here:
 
@@ -154,7 +156,7 @@ OTHER PROGRAMS:
 
 Other programs like https://www.LMStudio.ai allows access to most of STANDARD samplers, where as others (llamacpp only here) you may need to add to the json file(s) for a model and/or template preset.
 
-In most cases all llama_cpp parameters/samplers are available when using API / headless / server mode in "text-generation-webui", "koboldcpp", "Olama", "backyard", and "lmstudio" (as well as other apps too).
+In most cases all llama_cpp parameters/samplers are available when using API / headless / server mode in "text-generation-webui", "koboldcpp", "Sillytavern", "Olama", "Backyard", and "LMStudio" (as well as other apps too).
 
 You can also use llama_cpp directly too. (IE: llama-server.exe) ; see :
 
@@ -162,6 +164,12 @@ https://github.com/ggerganov/llama.cpp
 
 (scroll down on the main page for more apps/programs to use GGUFs too that connect to / use the LLAMA-CPP package.)
 
+Special note:
+
+It appears "DRY" / "XTC" samplers has been added to LLAMACPP and SILLYTAVERN. 
+
+It is available via "llama-server.exe". Likely this sampler will also become available "downstream" in applications that use LLAMACPP in due time.
+
 ---
 
 DETAILED NOTES ON PARAMETERS, SAMPLERS and ADVANCED SAMPLERS:
@@ -176,11 +184,10 @@ https://github.com/oobabooga/text-generation-webui/wiki/03-%E2%80%90-Parameters-
 
 Additional Links (on parameters, samplers and advanced samplers):
 
-DRY => https://github.com/oobabooga/text-generation-webui/pull/5677
-
-DRY => https://www.reddit.com/r/KoboldAI/comments/1e49vpt/dry_sampler_questionsthat_im_sure_most_of_us_are/
-
-DRY => https://www.reddit.com/r/KoboldAI/comments/1eo4r6q/dry_settings_questions/
+DRY 
+- https://github.com/oobabooga/text-generation-webui/pull/5677
+- https://www.reddit.com/r/KoboldAI/comments/1e49vpt/dry_sampler_questionsthat_im_sure_most_of_us_are/
+- https://www.reddit.com/r/KoboldAI/comments/1eo4r6q/dry_settings_questions/
 
 Samplers : https://gist.github.com/kalomaze/4473f3f975ff5e5fade06e632498f73e
 
@@ -267,7 +274,7 @@ This covers both Imatrix and regular quants.
 
 Imatrix can be applied to any quant - "Q" or "IQ" - however, IQ1s to IQ3_S REQUIRE an imatrix dataset / imatrixing process before quanting.
 
-This chart shows the order in terms of "BPW" for each quant (mapped below with relative "strength" to one another) with "IQ1_S" with the least, and "Q8_0" with the most:
+This chart shows the order in terms of "BPW" for each quant (mapped below with relative "strength" to one another) with "IQ1_S" with the least, and "Q8_0" (F16 is full precision) with the most:
 
 <small>
 <PRE>
@@ -316,11 +323,11 @@ Here are some Imatrix Neo Models:
 
 Suggestions for Imatrix NEO quants:
 
-- The LOWER the quant the STRONGER the Imatrix effect is, and therefore the stronger the horror "tint" so to speak
-- Due to the unique nature of this project, quants IQ1s to IQ4s are recommended for maximum horror effect with IQ4_XS the most balanced in terms of power and bits.
+- The LOWER the quant the STRONGER the Imatrix effect is, and therefore the stronger the "tint" so to speak
+- Due to the unique nature of this project, quants IQ1s to IQ4s are recommended for maximum effect with IQ4_XS the most balanced in terms of power and bits.
 - Secondaries are Q2s-Q4s. Imatrix effect is still strong in these quants.
 - Effects diminish quickly from Q5s and up. 
-- Q8 there is no change (as the Imatrix process does not affect this quant), and therefore was not uploaded.
+- Q8/F16 there is no change (as the Imatrix process does not affect this quant), and therefore not included.
 
 ---
 
@@ -411,12 +418,6 @@ Please see sections below this for advanced usage, more details, settings notes
 
 </small>
 
-Special note:
-
-It appears "DRY" / "XTC" samplers has been added to LLAMACPP. 
-
-It is available via "llama-server.exe". Likely this sampler will also become available "downstream" in applications that use LLAMACPP in due time.
-
 --- 
 
 HOW TO TEST EACH PARAMETER(s), SAMPLER(s) and ADVANCED SAMPLER(s)
@@ -722,6 +723,8 @@ i.e. `--logit-bias 15043+1` to increase likelihood of token ' Hello',  or `--log
 
 This may or may not be available. This requires a bit more work.
 
+Note: +- range is 0 to 100.
+
 IN "oobabooga/text-generation-webui" there is "TOKEN BANNING":
 
 This is a very powerful pruning method; which can drastically alter output generation.