umisetokikaze commited on
Commit
3da205d
β€’
1 Parent(s): 9f1bfd4

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +46 -0
README.md ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ - ja
6
+ tags:
7
+ - finetuned
8
+ library_name: transformers
9
+ pipeline_tag: text-generation
10
+ ---
11
+ <img src="./" width="100%" height="20%" alt="">
12
+
13
+ # Model Card for Ninja-v1-128k
14
+
15
+ The Mistral-7B--based Large Language Model (LLM) is an noveldataset fine-tuned version of the Mistral-7B-v0.1
16
+
17
+ VecTeus has the following changes compared to Mistral-7B-v0.1.
18
+ - 128k context window (8k context in v0.1)
19
+ - Achieving both high quality Japanese and English generation
20
+ - Memory ability that does not forget even after long-context generation
21
+
22
+ This model was created with the help of GPUs from the first LocalAI hackathon.
23
+
24
+ We would like to take this opportunity to thank
25
+
26
+ ## List of Creation Methods
27
+
28
+ - Chatvector for multiple models
29
+ - Simple linear merging of result models
30
+ - Domain and Sentence Enhancement with LORA
31
+ - Context expansion
32
+
33
+ ## Instruction format
34
+
35
+ Freed from templates. Congratulations
36
+
37
+ ## Example prompts to improve (Japanese)
38
+
39
+ - BAD: あγͺγŸγ―β—‹β—‹γ¨γ—γ¦ζŒ―γ‚‹θˆžγ„γΎγ™
40
+ - GOOD: あγͺγŸγ―β—‹β—‹γ§γ™
41
+
42
+ - BAD: あγͺγŸγ―β—‹β—‹γŒγ§γγΎγ™
43
+ - GOOD: あγͺγŸγ―β—‹β—‹γ‚’γ—γΎγ™
44
+
45
+ # Other points to keep in mind
46
+ If possible, we recommend inferring with llamacpp rather than Transformers.