Very impressive!
#4
by
DanielAdler666
- opened
I was surprised after a very long chat it kept up pretty nicely without any hallucinations or repetition! Very impressive indeed.
LM Studio shows it as a 34b model, what's that about? I use the Zephyr preset for it, works fine, but would something else work better?
I use OOBABOOGA
HOW DO I USE THIS MODEL?
I was surprised after a very long chat it kept up pretty nicely without any hallucinations or repetition! Very impressive indeed.
LM Studio shows it as a 34b model, what's that about? I use the Zephyr preset for it, works fine, but would something else work better?
Wow, it's a model that was ore-trsined with 34 billion parameters. Your machine should be very good to run a model this size depending on the quantization you're using. 👍