Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -8,13 +8,13 @@ tags:
|
|
8 |
license: apache-2.0
|
9 |
---
|
10 |
|
11 |
-
# Qwen2-7B-embed-base
|
12 |
|
13 |
-
This is a base model derived from Qwen2.5-7B
|
14 |
It's intended to be used as a base for embedding tasks and further fine-tuning.
|
15 |
|
16 |
## Model Details
|
17 |
-
- Base model: Qwen2.5-7B
|
18 |
- The 'lm_head' layer has been removed
|
19 |
- Maintains the original model's norm layers
|
20 |
- Suitable for embedding tasks and custom head additions
|
|
|
8 |
license: apache-2.0
|
9 |
---
|
10 |
|
11 |
+
# Qwen2.5-7B-embed-base
|
12 |
|
13 |
+
This is a base model derived from Qwen2.5-7B with the language modeling head removed.
|
14 |
It's intended to be used as a base for embedding tasks and further fine-tuning.
|
15 |
|
16 |
## Model Details
|
17 |
+
- Base model: Qwen2.5-7B
|
18 |
- The 'lm_head' layer has been removed
|
19 |
- Maintains the original model's norm layers
|
20 |
- Suitable for embedding tasks and custom head additions
|