intervitens commited on
Commit
6c7e1a7
1 Parent(s): 3fd7f56

Upload folder using huggingface_hub

Browse files
.gitattributes CHANGED
@@ -33,3 +33,10 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ internlm2-limarp-chat-20b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
37
+ internlm2-limarp-chat-20b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ internlm2-limarp-chat-20b.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ internlm2-limarp-chat-20b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ internlm2-limarp-chat-20b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ internlm2-limarp-chat-20b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
42
+ internlm2-limarp-chat-20b.q8_0.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: [intervitens/internlm2-base-20b-llama]
3
+ language:
4
+ - en
5
+ pipeline_tag: text-generation
6
+ tags:
7
+ - mergekit
8
+ - merge
9
+ license: other
10
+ datasets:
11
+ - lemonilia/LimaRP
12
+
13
+ ---
14
+
15
+ Experimental model, LimaRP LoRA trained on top of internlm2-base-20b with 8192 context length and merged with internlm2-chat-20b.
16
+
17
+ Prompt format is ChatML.
18
+
19
+ ***
20
+
21
+ # internlm2-06limarp-1chat-TASK_ARITHM-20b-v0.03
22
+
23
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
24
+
25
+ ## Merge Details
26
+ ### Merge Method
27
+
28
+ This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using intervitens/internlm2-base-20b-llama as a base.
29
+
30
+ ### Models Merged
31
+
32
+ The following models were included in the merge:
33
+ * ./internlm2-limarp-20b-v0.03
34
+ * ./internlm2-chat-20b-llama
35
+
36
+ ### Configuration
37
+
38
+ The following YAML configuration was used to produce this model:
39
+
40
+ ```yaml
41
+ models:
42
+ - model: ./internlm2-chat-20b-llama
43
+ parameters:
44
+ weight: 1.0
45
+ - model: ./internlm2-limarp-20b-v0.03
46
+ parameters:
47
+ weight: 0.6
48
+ merge_method: task_arithmetic
49
+ base_model: ./internlm2-base-20b-llama
50
+ parameters:
51
+ #normalize: false
52
+ #int8_mask: true
53
+ dtype: bfloat16
54
+
55
+
56
+ ```
internlm2-limarp-chat-20b.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:40ef1d999e68cc1eabf6b4291508e20d89a87f9f185e8766eea97bed3d366558
3
+ size 9722278912
internlm2-limarp-chat-20b.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:50abf60dacc1f8006455238d3206bf9ebc0df3d767ce35a7415f9c015aac06a6
3
+ size 11984468992
internlm2-limarp-chat-20b.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:84d3734f655565d9d516493d29f7bdc92c08b18e6dd2b06ed93e30787039b15f
3
+ size 11401329664
internlm2-limarp-chat-20b.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c6d7c9fa9b3dcf910a3af11c10785039cce59456536a775216c71a45b63cadb
3
+ size 14075100160
internlm2-limarp-chat-20b.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:26e6ec3a348837ba384ed6387ce64076b0d334c8cd0ed2e589f04ef64b7eaeee
3
+ size 13734181888
internlm2-limarp-chat-20b.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:379e2f796479bfe642ac479fdc8ff6244f624dd5947e7195281df26d695c703d
3
+ size 16296395776
internlm2-limarp-chat-20b.q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7363cbd7cf42e1be824a383fe26ed13eec916a6b28f946f707027fa405ed615a
3
+ size 21106373600