Update README.md
Browse files
README.md
CHANGED
|
@@ -54,7 +54,7 @@ Cephalo provides a robust framework for multimodal interaction and understanding
|
|
| 54 |
|
| 55 |
The image shows a summary of model merging approach, constructing larger models from smaller pre-trained building blocks. a, Fine-tuning the base model. b, Constructing the larger, merged model by combining the whole or parts of smaller models. c, Fine-tuning the integrated hybrid, merged, model.
|
| 56 |
|
| 57 |
-
### Mixture-of-
|
| 58 |
|
| 59 |
- [lamm-mit/Cephalo-Phi-3-MoE-vision-128k-3x4b-beta](https://huggingface.co/lamm-mit/Cephalo-Phi-3-MoE-vision-128k-3x4b-beta)
|
| 60 |
- Mixture-of-expert model based on several smaller Cephalo-Phi-3 models.
|
|
|
|
| 54 |
|
| 55 |
The image shows a summary of model merging approach, constructing larger models from smaller pre-trained building blocks. a, Fine-tuning the base model. b, Constructing the larger, merged model by combining the whole or parts of smaller models. c, Fine-tuning the integrated hybrid, merged, model.
|
| 56 |
|
| 57 |
+
### Mixture-of-Experts models
|
| 58 |
|
| 59 |
- [lamm-mit/Cephalo-Phi-3-MoE-vision-128k-3x4b-beta](https://huggingface.co/lamm-mit/Cephalo-Phi-3-MoE-vision-128k-3x4b-beta)
|
| 60 |
- Mixture-of-expert model based on several smaller Cephalo-Phi-3 models.
|