Delcos commited on
Commit
24bf269
1 Parent(s): 91de96a

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +56 -0
README.md ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-nd-4.0
3
+ language:
4
+ - en
5
+ library_name: transformers
6
+ pipeline_tag: text-generation
7
+ tags:
8
+ - Mistral
9
+ - Pygmalion
10
+ - llama-2
11
+ - llama-2-7b
12
+ ---
13
+
14
+
15
+ # MistralPy-7b
16
+
17
+ This is a merger focusing on preserving the roleplay abilities of Pygmalion while gaining the improved results from Mistral. This model works best for roleplay but is still fairly capable assistant. The smaller (7b) size does mean it isn't perfect at more complex reasoning tasks, but this should be addressed in the larger version that I'll upload soon (when I can get Mistral to play along).
18
+
19
+ [GGUF version done by TheBloke](https://huggingface.co/TheBloke/Mistral-Pygmalion-7B-GGUF)
20
+
21
+
22
+
23
+ # LLM Leaderboard Evaluation
24
+
25
+ | Metric | Value |
26
+ |-----------------------|---------------------------|
27
+ | Avg. | 44.58 |
28
+ | ARC (25-shot) | 54.44 |
29
+ | HellaSwag (10-shot) | 78.48 |
30
+ | MMLU (5-shot) | 49.23 |
31
+ | TruthfulQA (0-shot) | 41.82 |
32
+ | Winogrande (5-shot) | 75.3 |
33
+ | GSM8K (5-shot) | 6.82 |
34
+ | DROP (3-shot) | 5.94 |
35
+
36
+
37
+ ### Prompt Template
38
+ ```
39
+ ### Instruction:
40
+ {Prompt & Backstory}
41
+ ### Assistant:
42
+ {Output}
43
+ ```
44
+ Example:
45
+
46
+ ```
47
+ ### Instruction:
48
+ You are Sally, a fun 19 year old woman. Her favorite animal is "cat". Her favoritate color is "blue". She enjoys grape juice and cake.
49
+ ### Assistant:
50
+ Sally: Hi, how are you?
51
+ User: Okay, you?
52
+ ```
53
+
54
+ # Send a message
55
+ [Steam](https://steamcommunity.com/id/delcos/)
56
+ #### Discord: delcos69