Update README.md
Browse files
README.md
CHANGED
@@ -66,6 +66,7 @@ min_p: 0.1 - 0.2 # Crucial for NeMo
|
|
66 |
\- Some people have been having issues with run-on generations for Lyra-v3. Kind of weird, when I never had issues.
|
67 |
<br>\- Anyway, make sure not to skip special tokens, or ban EOS tokens. I think this is the main problem that happens when v3 was to be quanted. The special tokens map is fucked in v3, Quantizing tools likely spazzed out seeing it. I blame llamafactory for it. It ran fine unquantised.
|
68 |
<br>\- I like long generations, though I can control it easily to create short ones. If you're struggling, prompt better. Fix your system prompts, use an Author's Note, use a prefill. They are there for a reason.
|
69 |
-
<br>\- Lyra passes my internal benchmark suite, hence why I'm releasing it.
|
70 |
<br>\- Issues like roleplay format are what I consider worthless, as it follows few-shot examples fine. This is not a priority for me to 'fix', as I see no isses with it.
|
71 |
-
<br>\- If you don't like it, just try another model? Plenty of other choices. Ymmv, I like it.
|
|
|
|
66 |
\- Some people have been having issues with run-on generations for Lyra-v3. Kind of weird, when I never had issues.
|
67 |
<br>\- Anyway, make sure not to skip special tokens, or ban EOS tokens. I think this is the main problem that happens when v3 was to be quanted. The special tokens map is fucked in v3, Quantizing tools likely spazzed out seeing it. I blame llamafactory for it. It ran fine unquantised.
|
68 |
<br>\- I like long generations, though I can control it easily to create short ones. If you're struggling, prompt better. Fix your system prompts, use an Author's Note, use a prefill. They are there for a reason.
|
69 |
+
<br>\- Lyra passes my internal benchmark suite, hence why I'm releasing it. Do I like it? Yes? it's out. that's it. They are my models for my enjoyment.
|
70 |
<br>\- Issues like roleplay format are what I consider worthless, as it follows few-shot examples fine. This is not a priority for me to 'fix', as I see no isses with it.
|
71 |
+
<br>\- If you don't like it, just try another model? Plenty of other choices. Ymmv, I like it.
|
72 |
+
<br>\- This may sound rough, but Roleplay is subjective. What I like, you may not like. It's fine.
|