Text Generation
GGUF
English
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
science fiction
romance
all genres
uncensored
story
writing
vivid prosing
vivid writing
fiction
roleplaying
bfloat16
swearing
rp
horror
gemma
mergekit
Not-For-All-Audiences
Inference Endpoints
conversational
Update README.md
Browse files
README.md
CHANGED
|
@@ -245,7 +245,8 @@ Example generation with "normal q2k", "MAX-CPU q2k", and "MAX q2k".
|
|
| 245 |
Note that "normal q2k" is still from the float32 master, and also contains augments itself (just like all other
|
| 246 |
quants here).
|
| 247 |
|
| 248 |
-
I also set "temp=0" during generation to further "knee-cap" the model so to speak
|
|
|
|
| 249 |
|
| 250 |
These generations represent the least creative outputs, and the model at its lowest quant (least powerful).
|
| 251 |
|
|
|
|
| 245 |
Note that "normal q2k" is still from the float32 master, and also contains augments itself (just like all other
|
| 246 |
quants here).
|
| 247 |
|
| 248 |
+
I also set "temp=0" during generation to further "knee-cap" the model so to speak and also ensures the generations
|
| 249 |
+
between different quants are as fair as possible.
|
| 250 |
|
| 251 |
These generations represent the least creative outputs, and the model at its lowest quant (least powerful).
|
| 252 |
|