File size: 10,294 Bytes
48aeaf1 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 |
---
base_model:
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
- win10/Qwen2.5-2B-Instruct
tags:
- merge
- mergekit
- lazymergekit
- win10/Qwen2.5-2B-Instruct
---
# Qwen2.5-4B-Instruct
Qwen2.5-4B-Instruct is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
* [win10/Qwen2.5-2B-Instruct](https://huggingface.co/win10/Qwen2.5-2B-Instruct)
## 🧩 Configuration
```yaml
dtype: bfloat16
merge_method: passthrough
slices:
- sources:
- layer_range: [0, 2]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [1, 3]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [2, 4]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [3, 5]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [4, 6]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [5, 7]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [6, 8]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [7, 9]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [8, 10]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [9, 11]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [10, 12]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [11, 13]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [12, 14]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [13, 15]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [14, 16]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [15, 17]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [16, 18]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [17, 19]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [18, 20]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [19, 21]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [20, 22]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [21, 23]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [22, 24]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [23, 25]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [24, 26]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [25, 27]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [26, 28]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [27, 29]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [28, 30]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [29, 31]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [30, 32]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [31, 33]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [32, 34]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [33, 35]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [34, 36]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [35, 37]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [36, 38]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [37, 39]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [38, 40]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [39, 41]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [40, 42]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [41, 43]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [42, 44]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [43, 45]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [44, 46]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [45, 47]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [46, 48]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [47, 49]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [48, 50]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [49, 51]
model: win10/Qwen2.5-2B-Instruct
- sources:
- layer_range: [50, 52]
model: win10/Qwen2.5-2B-Instruct
```
## 💻 Usage
```python
!pip install -qU transformers accelerate
from transformers import AutoTokenizer
import transformers
import torch
model = "win10/Qwen2.5-4B-Instruct"
messages = [{"role": "user", "content": "What is a large language model?"}]
tokenizer = AutoTokenizer.from_pretrained(model)
prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
pipeline = transformers.pipeline(
"text-generation",
model=model,
torch_dtype=torch.float16,
device_map="auto",
)
outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
print(outputs[0]["generated_text"])
``` |