Kunger
/

Sakura-13B-v0.11Pre-4Bit-AWQ

Text Generation

4-bit precision

Model card Files Files and versions Community

原始模型:Sakura-13B-LNovel-v0.11pre1

4Bit AWQ量化，未测试，不建议使用。

采用带有flash_attn的环境进行量化

Downloads last month: 15

Safetensors

Model size

2.69B params

Tensor type

I32

·

BF16

·

FP16

·

Inference Examples

Text Generation

Inference API (serverless) does not yet support model repos that contain custom code.