Update README.md
Browse files
README.md
CHANGED
@@ -15,7 +15,7 @@ tags:
|
|
15 |
- qwen1.5
|
16 |
- qwen2
|
17 |
---
|
18 |
-
This is the Mistral version of [Qwen1.5-
|
19 |
The original codebase can be found at: (https://github.com/hiyouga/LLaMA-Factory/blob/main/tests/llamafy_qwen.py).
|
20 |
I have made modifications to make it compatible with qwen1.5.
|
21 |
This model is converted with https://github.com/Minami-su/character_AI_open/blob/main/mistral_qwen2.py
|
@@ -60,26 +60,3 @@ generate_ids = model.generate(inputs,max_length=32768, streamer=streamer)
|
|
60 |
```
|
61 |
|
62 |
## Test
|
63 |
-
load in 4bit
|
64 |
-
```
|
65 |
-
hf-causal (pretrained=Qwen1.5-7B-Chat), limit: None, provide_description: False, num_fewshot: 0, batch_size: 8
|
66 |
-
| Task |Version| Metric |Value | |Stderr|
|
67 |
-
|-------------|------:|--------|-----:|---|-----:|
|
68 |
-
|arc_challenge| 0|acc |0.4155|± |0.0144|
|
69 |
-
| | |acc_norm|0.4480|± |0.0145|
|
70 |
-
|truthfulqa_mc| 1|mc1 |0.3513|± |0.0167|
|
71 |
-
| | |mc2 |0.5165|± |0.0159|
|
72 |
-
|winogrande | 0|acc |0.6330|± |0.0135|
|
73 |
-
```
|
74 |
-
load in 4bit
|
75 |
-
```
|
76 |
-
hf-causal (pretrained=Qwen1.5-7B-Chat_mistral), limit: None, provide_description: False, num_fewshot: 0, batch_size: 16
|
77 |
-
| Task |Version| Metric |Value | |Stderr|
|
78 |
-
|-------------|------:|--------|-----:|---|-----:|
|
79 |
-
|arc_challenge| 0|acc |0.4172|± |0.0144|
|
80 |
-
| | |acc_norm|0.4480|± |0.0145|
|
81 |
-
|truthfulqa_mc| 1|mc1 |0.3488|± |0.0167|
|
82 |
-
| | |mc2 |0.5161|± |0.0159|
|
83 |
-
|winogrande | 0|acc |0.6306|± |0.0136|
|
84 |
-
```
|
85 |
-
```
|
|
|
15 |
- qwen1.5
|
16 |
- qwen2
|
17 |
---
|
18 |
+
This is the Mistral version of [Qwen1.5-14B-Chat](https://huggingface.co/Qwen/Qwen1.5-14B-Chat) model by Alibaba Cloud.
|
19 |
The original codebase can be found at: (https://github.com/hiyouga/LLaMA-Factory/blob/main/tests/llamafy_qwen.py).
|
20 |
I have made modifications to make it compatible with qwen1.5.
|
21 |
This model is converted with https://github.com/Minami-su/character_AI_open/blob/main/mistral_qwen2.py
|
|
|
60 |
```
|
61 |
|
62 |
## Test
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|