float8_e4m3fn or fp8 or preferablly GGUF format weights
#20
by
MayensGuds
- opened
that would be really good, and it would push the project out to every one, user Seanscripts provided bf16, further quant would be awesome.