How much GPU VRAM is needed for Qwen2.5 14B GGUF file?

by JLouisBiz - opened Dec 24, 2024

Dec 24, 2024

How much GPU VRAM is needed for Qwen2.5 14B GGUF file?

What token per hour can it give?

I see that model is excellent, thanks to Alibaba.com advancing the civilization with the free software, free as in freedom.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment