metadata
license: creativeml-openrail-m
language:
- en
This is a (25/25)/50 merge of Mr. Seeker's GPT-J Janeway and Shinen models and GPT-R. If interested, please visit digitous/GPT-R and KoboldAI to get an understanding of what these models are comprised of. This model is not intended for minors.
Mr. Seeker, maker of incredible fine-tuned models: https://huggingface.co/KoboldAI/GPT-J-6B-Janeway
https://huggingface.co/KoboldAI/GPT-J-6B-Shinen
Donate to help ameliorate server fees: https://www.patreon.com/mrseeker
GPT-Ronin: https://huggingface.co/digitous/GPT-R
Weight merge Script credit to Concedo: https://huggingface.co/concedo
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 35.14 |
| ARC (25-shot) | 40.44 |
| HellaSwag (10-shot) | 67.36 |
| MMLU (5-shot) | 31.24 |
| TruthfulQA (0-shot) | 34.49 |
| Winogrande (5-shot) | 65.35 |
| GSM8K (5-shot) | 2.27 |
| DROP (3-shot) | 4.8 |