Qwen-SFT
Collection
A series of fine-tuned models based on the Qwen model
•
5 items
•
Updated
使用数据集alpaca-data-gpt4-chinese、sft_zh、ruozhiba对Qwen1.5-7B-Chat微调，测试结果显示CEVAL和MMLU分数均有上升
模型：
数据集：
- https://huggingface.co/datasets/TigerResearch/sft_zh
- https://huggingface.co/datasets/silk-road/alpaca-data-gpt4-chinese
- https://huggingface.co/datasets/LooksJuicy/ruozhiba
结果
| 模型名称 | CEVAL | MMLU |
|---|---|---|
| Qwen1.5-7B-Chat | 68.61 | 61.56 |
| Qwen1.5-7B-Chat-sft-lora-tigerbot-alpacadatagpt4-ruozhiba-1epoch | 71.75 | 62.43 |
License
This project utilizes certain datasets and checkpoints that are subject to their respective original licenses. Users must comply with all terms and conditions of these original licenses. The content of this project itself is licensed under the Apache license 2.0.