Update README.md
Browse files
README.md
CHANGED
@@ -117,8 +117,11 @@ model-index:
|
|
117 |
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=icefog72/IceTeaRP-7b
|
118 |
name: Open LLM Leaderboard
|
119 |
---
|
120 |
-
# IceTeaRP-7b
|
121 |
|
|
|
|
|
|
|
|
|
122 |

|
123 |
|
124 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
@@ -144,9 +147,7 @@ Can develop repetition problem at 16k-32k without good RP rules/CoT in promt.
|
|
144 |
|
145 |
You can try edit "rope_theta": 100000.0 => "rope_theta": 60000.0 to make it even more slightly coherent(hard to find balance).
|
146 |
|
147 |
-
## Advertisement
|
148 |
|
149 |
-
- Check out new merge model [IceLemonTeaRP-32k-7b](https://huggingface.co/icefog72/IceLemonTeaRP-32k-7b)
|
150 |
|
151 |
### Merge Method
|
152 |
|
|
|
117 |
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=icefog72/IceTeaRP-7b
|
118 |
name: Open LLM Leaderboard
|
119 |
---
|
|
|
120 |
|
121 |
+
## Advertisement
|
122 |
+
|
123 |
+
- Check out new merge model without repetition problem [IceLemonTeaRP-32k-7b](https://huggingface.co/icefog72/IceLemonTeaRP-32k-7b)
|
124 |
+
# IceTeaRP-7b
|
125 |

|
126 |
|
127 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
|
|
147 |
|
148 |
You can try edit "rope_theta": 100000.0 => "rope_theta": 60000.0 to make it even more slightly coherent(hard to find balance).
|
149 |
|
|
|
150 |
|
|
|
151 |
|
152 |
### Merge Method
|
153 |
|