Hugging Face's logo

Minami-su
/
Qwen1.5-0.5B-Chat_llamafy

Text Generation
Transformers
PyTorch
English
Chinese
llama
qwen
qwen1.5
qwen2
conversational
text-generation-inference
Model card Files Community
2
Minami-su commited on
Commit
178a3f0
·
verified ·
1 Parent(s): f67dba6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -40,6 +40,7 @@ generate_ids = model.generate(inputs,max_length=2048, streamer=streamer)
40
  load in 4bit
41
 
42
  hf-causal (pretrained=Qwen1.5-0.5B-Chat), limit: None, provide_description: False, num_fewshot: 0, batch_size: 32
 
43
  | Task |Version| Metric |Value | |Stderr|
44
  |-------------|------:|--------|-----:|---|-----:|
45
  |arc_challenge| 0|acc |0.2389|± |0.0125|
@@ -51,10 +52,11 @@ hf-causal (pretrained=Qwen1.5-0.5B-Chat), limit: None, provide_description: Fals
51
  load in 4bit
52
 
53
  hf-causal (pretrained=Qwen1.5-0.5B-Chat_llamafy), limit: None, provide_description: False, num_fewshot: 0, batch_size: 32
 
54
  | Task |Version| Metric |Value | |Stderr|
55
  |-------------|------:|--------|-----:|---|-----:|
56
  |arc_challenge| 0|acc |0.2398|± |0.0125|
57
  | | |acc_norm|0.2705|± |0.0130|
58
  |truthfulqa_mc| 1|mc1 |0.2534|± |0.0152|
59
  | | |mc2 |0.4322|± |0.0151|
60
- |winogrande | 0|acc |0.5556|± |0.0140|
 
40
  load in 4bit
41
 
42
  hf-causal (pretrained=Qwen1.5-0.5B-Chat), limit: None, provide_description: False, num_fewshot: 0, batch_size: 32
43
+
44
  | Task |Version| Metric |Value | |Stderr|
45
  |-------------|------:|--------|-----:|---|-----:|
46
  |arc_challenge| 0|acc |0.2389|± |0.0125|
 
52
  load in 4bit
53
 
54
  hf-causal (pretrained=Qwen1.5-0.5B-Chat_llamafy), limit: None, provide_description: False, num_fewshot: 0, batch_size: 32
55
+
56
  | Task |Version| Metric |Value | |Stderr|
57
  |-------------|------:|--------|-----:|---|-----:|
58
  |arc_challenge| 0|acc |0.2398|± |0.0125|
59
  | | |acc_norm|0.2705|± |0.0130|
60
  |truthfulqa_mc| 1|mc1 |0.2534|± |0.0152|
61
  | | |mc2 |0.4322|± |0.0151|
62
+ |winogrande | 0|acc |0.5556|± |0.0140|