--- base_model: beomi/Solar-Ko-Recovery-11B language: - en license: apache-2.0 tags: - text-generation-inference - transformers - unsloth - llama - trl --- # KoAlpaca-RealQA-Solar-Ko-Recovery-11B-Merged LoRA merged model from beomi/KoAlpaca-RealQA-Solar-Ko-Recovery-11B - **Developed by:** beomi - **License:** apache-2.0 - **Finetuned from model :** beomi/Solar-Ko-Recovery-11B ## Eval with LogicKor **Default** | Category | Single turn | Multi turn | |---|---|---| | 이해(Understanding) | 8.43 | 5.86 | | 수학(Math) | 3.86 | 1.00 | | 글쓰기(Writing) | 9.71 | 7.71 | | 추론(Reasoning) | 7.57 | 3.86 | | 코딩(Coding) | 7.57 | 7.00 | | 문법(Grammar) | 7.43 | 4.14 | | Category | Score | |---|---| | Single turn | 7.43 | | Multi turn | 4.93 | | Overall | 6.18 | **1-Shot** | Category | Single turn | Multi turn | |---|---|---| | 추론(Reasoning) | 7.57 | 4.43 | | 코딩(Coding) | 7.29 | 8.57 | | 수학(Math) | 2.86 | 1.71 | | 글쓰기(Writing) | 9.29 | 7.57 | | 이해(Understanding) | 7.43 | 5.86 | | 문법(Grammar) | 7.29 | 4.71 | | Category | Score | |---|---| | Single turn | 6.95 | | Multi turn | 5.48 | | Overall | 6.21 | **CoT-1-Shot** | Category | Single turn | Multi turn | |---|---|---| | 코딩(Coding) | 7.14 | 8.14 | | 추론(Reasoning) | 6.86 | 3.57 | | 글쓰기(Writing) | 9.71 | 7.71 | | 수학(Math) | 2.29 | 1.14 | | 이해(Understanding) | 7.43 | 7.00 | | 문법(Grammar) | 7.29 | 3.14 | | Category | Score | |---|---| | Single turn | 6.79 | | Multi turn | 5.12 | | Overall | 5.95 | [](https://github.com/unslothai/unsloth)