update readme
Browse files- README.md +7 -7
- config.json +1 -1
README.md
CHANGED
@@ -16,9 +16,9 @@ datasets:
|
|
16 |
|
17 |
## Introduction
|
18 |
|
19 |
-
The Imp project aims to provide a family of a strong multimodal `small` language models (MSLMs). Our `Imp-v1.5-2B-Qwen1.5` is a strong MSLM with only **2B** parameters, which is build upon a small yet powerful SLM [Qwen1.5-1.8B-Chat ](https://huggingface.co/Qwen/Qwen1.5-1.8B-Chat)(1.8B) and a powerful visual encoder [SigLIP ](https://huggingface.co/google/siglip-so400m-patch14-384)(0.4B), and trained on
|
20 |
|
21 |
-
As shown in the Table below, `Imp-v1.5-2B-Qwen1.5` significantly outperforms the counterparts of similar model sizes
|
22 |
|
23 |
We release our model weights and provide an example below to run our model . Detailed technical report and corresponding training/evaluation code will be released soon on our [GitHub repo](https://github.com/MILVLG/imp). We will persistently improve our model and release the next versions to further improve model performance :)
|
24 |
|
@@ -85,10 +85,10 @@ This project is maintained by the [MILVLG](https://github.com/MILVLG)@Hangzhou D
|
|
85 |
If you use our model or refer our work in your studies, please cite:
|
86 |
|
87 |
```bibtex
|
88 |
-
@
|
89 |
-
|
90 |
-
|
91 |
-
|
92 |
-
|
93 |
}
|
94 |
```
|
|
|
16 |
|
17 |
## Introduction
|
18 |
|
19 |
+
The Imp project aims to provide a family of a strong multimodal `small` language models (MSLMs). Our `Imp-v1.5-2B-Qwen1.5` is a strong MSLM with only **2B** parameters, which is build upon a small yet powerful SLM [Qwen1.5-1.8B-Chat ](https://huggingface.co/Qwen/Qwen1.5-1.8B-Chat)(1.8B) and a powerful visual encoder [SigLIP ](https://huggingface.co/google/siglip-so400m-patch14-384)(0.4B), and trained on on 1M mixed dataset.
|
20 |
|
21 |
+
As shown in the Table below, `Imp-v1.5-2B-Qwen1.5` significantly outperforms the counterparts of similar model sizes.
|
22 |
|
23 |
We release our model weights and provide an example below to run our model . Detailed technical report and corresponding training/evaluation code will be released soon on our [GitHub repo](https://github.com/MILVLG/imp). We will persistently improve our model and release the next versions to further improve model performance :)
|
24 |
|
|
|
85 |
If you use our model or refer our work in your studies, please cite:
|
86 |
|
87 |
```bibtex
|
88 |
+
@article{imp2024,
|
89 |
+
title={Imp: Highly Capable Large Multimodal Models for Mobile Devices},
|
90 |
+
author={Shao, Zhenwei and Yu, Zhou and Yu, Jun and Ouyang, Xuecheng and Lihao, Zheng and Zhenbiao, Gai and Mingyang, Wang and Jiajun, Ding},
|
91 |
+
journal={arXiv preprint arXiv:2405.12107},
|
92 |
+
year={2024}
|
93 |
}
|
94 |
```
|
config.json
CHANGED
@@ -1,5 +1,5 @@
|
|
1 |
{
|
2 |
-
"_name_or_path": "MILVLG/
|
3 |
"architectures": [
|
4 |
"ImpQwen2ForCausalLM"
|
5 |
],
|
|
|
1 |
{
|
2 |
+
"_name_or_path": "MILVLG/Imp-v1.5-2B-Qwen1.5",
|
3 |
"architectures": [
|
4 |
"ImpQwen2ForCausalLM"
|
5 |
],
|