Update README.md
Browse files
README.md
CHANGED
|
@@ -47,6 +47,10 @@ Cephalo provides a robust framework for multimodal interaction and understanding
|
|
| 47 |
- [lamm-mit/Cephalo-Idefics-2-vision-12b-alpha](https://huggingface.co/lamm-mit/Cephalo-Idefics-2-vision-12b-alpha)
|
| 48 |
- Merged model, 32+16=48 layers, checkpoint after first epoch. Trained on GPT-4o distilled image-text data from Wikipedia and scientific papers (dataset derivived from both Idefics-2 and GPT-4o distillation of the paper corpus).
|
| 49 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 50 |
### Additional codes and tools
|
| 51 |
|
| 52 |
Additional codes and tools are provided at [https://github.com/lamm-mit/Cephalo](https://github.com/lamm-mit/Cephalo).
|
|
|
|
| 47 |
- [lamm-mit/Cephalo-Idefics-2-vision-12b-alpha](https://huggingface.co/lamm-mit/Cephalo-Idefics-2-vision-12b-alpha)
|
| 48 |
- Merged model, 32+16=48 layers, checkpoint after first epoch. Trained on GPT-4o distilled image-text data from Wikipedia and scientific papers (dataset derivived from both Idefics-2 and GPT-4o distillation of the paper corpus).
|
| 49 |
|
| 50 |
+
|
| 51 |
+
|
| 52 |
+
The image shows a summary of model merging approach, constructing larger models from smaller pre-trained building blocks.
|
| 53 |
+
|
| 54 |
### Additional codes and tools
|
| 55 |
|
| 56 |
Additional codes and tools are provided at [https://github.com/lamm-mit/Cephalo](https://github.com/lamm-mit/Cephalo).
|