THANK YOU!!

#25

by bobba84 - opened Feb 6, 2024

Feb 6, 2024

I love it! My 16GB 4060ti is getting over 5 tokens/s with the Q4_K_M file. Offloaded 12 layers, and it's using another 32GB system RAM.

You're a legend mate!

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment