SUSTech

/

SUS-Chat-34B

like 122

Follow

Southern university of science and technology 72

Whats the benefits of int4?

Whats the benefits of int4?

Can run on low memory GPU, I only have one A6000.

We would be happy to investigate. Could you explain how this differs from https://huggingface.co/SUSTech/SUS-Chat-34B/discussions/1?