csdc-atl
/

buffer-baichuan2-13B-rag-awq-int4

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

buffer-baichuan2-13B-rag-awq-int4

Ctrl+K

Ctrl+K

2 contributors

History: 2 commits

oilpig's picture

awq version for baichuan2 rag enhance

2f58c6c over 1 year ago

.gitattributes

1.52 kB

initial commit over 1 year ago
config.json

985 Bytes

awq version for baichuan2 rag enhance over 1 year ago
configuration_baichuan.py

1.56 kB

awq version for baichuan2 rag enhance over 1 year ago
generation_config.json

285 Bytes

awq version for baichuan2 rag enhance over 1 year ago
generation_utils.py

3.1 kB

awq version for baichuan2 rag enhance over 1 year ago
model.safetensors

9.13 GB
xet

awq version for baichuan2 rag enhance over 1 year ago
modeling_baichuan.py

32.8 kB

awq version for baichuan2 rag enhance over 1 year ago
quant_config.json

90 Bytes

awq version for baichuan2 rag enhance over 1 year ago
quantizer.py

9.11 kB

awq version for baichuan2 rag enhance over 1 year ago
special_tokens_map.json

544 Bytes

awq version for baichuan2 rag enhance over 1 year ago
tokenization_baichuan.py

9.03 kB

awq version for baichuan2 rag enhance over 1 year ago
tokenizer.model

2 MB
xet

awq version for baichuan2 rag enhance over 1 year ago
tokenizer_config.json

918 Bytes

awq version for baichuan2 rag enhance over 1 year ago