zeio
/

openchat-3.5-0106-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

openchat-3.5-0106-GPTQ

Commit History

fix(dtype): changed dtype from bfloat16 to float16

03d5b37
verified

zeio commited on Apr 3, 2024

feat(model): added model from the original repo

00532e9
verified

zeio commited on Apr 3, 2024

initial commit

d2fee7f
verified

zeio commited on Apr 3, 2024