Minimal GPU requirements

by tmk12 - opened Oct 6, 2024

tmk12

Oct 6, 2024

What is a minimal vram to run the model?

Javed7

Oct 8, 2024

Around 140GB

tmk12

Oct 9, 2024

Thanks!

tmk12 changed discussion status to closed Oct 9, 2024

imoc

21 days ago

•

Actually, 6 bits is already very good. 54GB + some cache headroom.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment