Minami-su
/

Qwen1.5-0.5B-Chat_llamafy

Text Generation

text-generation-inference

Model card Files Files and versions Community

Minami-su commited on Feb 24, 2024

Commit

2f79239

·

verified ·

1 Parent(s): 2e28103

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -37,7 +37,7 @@ generate_ids = model.generate(inputs,max_length=2048, streamer=streamer)
 ## Test
 hf-causal (pretrained=Qwen1.5-0.5B-Chat), limit: None, provide_description: False, num_fewshot: 0, batch_size: 32
 |    Task     |Version| Metric |Value |   |Stderr|
 |-------------|------:|--------|-----:|---|-----:|
@@ -46,7 +46,7 @@ hf-causal (pretrained=Qwen1.5-0.5B-Chat), limit: None, provide_description: Fals
 |truthfulqa_mc|      1|mc1     |0.2534|±  |0.0152|
 |             |       |mc2     |0.4322|±  |0.0151|
 |winogrande   |      0|acc     |0.5564|±  |0.0140|
 hf-causal (pretrained=Qwen1.5-0.5B-Chat_llamafy), limit: None, provide_description: False, num_fewshot: 0, batch_size: 32
 |    Task     |Version| Metric |Value |   |Stderr|
 |-------------|------:|--------|-----:|---|-----:|

 ## Test
+load in 4bit
 hf-causal (pretrained=Qwen1.5-0.5B-Chat), limit: None, provide_description: False, num_fewshot: 0, batch_size: 32
 |    Task     |Version| Metric |Value |   |Stderr|
 |-------------|------:|--------|-----:|---|-----:|
 |truthfulqa_mc|      1|mc1     |0.2534|±  |0.0152|
 |             |       |mc2     |0.4322|±  |0.0151|
 |winogrande   |      0|acc     |0.5564|±  |0.0140|
+load in 4bit
 hf-causal (pretrained=Qwen1.5-0.5B-Chat_llamafy), limit: None, provide_description: False, num_fewshot: 0, batch_size: 32
 |    Task     |Version| Metric |Value |   |Stderr|
 |-------------|------:|--------|-----:|---|-----:|