gguf version?

#1
by akhil3417 - opened

who be great if you can generate one!

Owner

hey, actually that was a merge I made just to test a notebook, one of the models I used is also contaminated with the test data if you wrote bc of the leaderboard score, however since you asked, I prepared it, here you go https://huggingface.co/eren23/slerp-test-turdus-beagle-GGUF enjoy! I wouldn't use it for something serious though :)

thanks very much for this version, (yeah i figured , udkai/Garrulus , was contaminated.)
just experimenting around with stuff,

what do you recommend for cpu only system? gguf , gptq , exl2 etc
m getting around 8t/s , with q5_km on 12400 and 16 gigs of ram , any thing that will boost it up?

Sign up or log in to comment