Update README.md
Browse files
README.md
CHANGED
@@ -3,7 +3,7 @@ base_model: vidore/colqwen2-base
|
|
3 |
language:
|
4 |
- en
|
5 |
library_name: colpali
|
6 |
-
license:
|
7 |
tags:
|
8 |
- colpali
|
9 |
- vidore-exclude
|
@@ -11,11 +11,10 @@ pipeline_tag: visual-document-retrieval
|
|
11 |
---
|
12 |
# ColQwen2: Visual Retriever based on Qwen2-VL-2B-Instruct with ColBERT strategy
|
13 |
|
14 |
-
|
15 |
It is a [Qwen2-VL-2B](https://huggingface.co/Qwen/Qwen2-VL-2B-Instruct) extension that generates [ColBERT](https://arxiv.org/abs/2004.12832)- style multi-vector representations of text and images.
|
16 |
It was introduced in the paper [ColPali: Efficient Document Retrieval with Vision Language Models](https://arxiv.org/abs/2407.01449) and first released in [this repository](https://github.com/ManuelFay/colpali)
|
17 |
|
18 |
-
This version is the untrained base version to guarantee deterministic projection layer initialization.
|
19 |
<p align="center"><img width=800 src="https://github.com/illuin-tech/colpali/blob/main/assets/colpali_architecture.webp?raw=true"/></p>
|
20 |
|
21 |
## Version specificity
|
|
|
3 |
language:
|
4 |
- en
|
5 |
library_name: colpali
|
6 |
+
license: apache-2.0
|
7 |
tags:
|
8 |
- colpali
|
9 |
- vidore-exclude
|
|
|
11 |
---
|
12 |
# ColQwen2: Visual Retriever based on Qwen2-VL-2B-Instruct with ColBERT strategy
|
13 |
|
14 |
+
ColQwen2 is a model based on a novel model architecture and training strategy based on Vision Language Models (VLMs) to efficiently index documents from their visual features.
|
15 |
It is a [Qwen2-VL-2B](https://huggingface.co/Qwen/Qwen2-VL-2B-Instruct) extension that generates [ColBERT](https://arxiv.org/abs/2004.12832)- style multi-vector representations of text and images.
|
16 |
It was introduced in the paper [ColPali: Efficient Document Retrieval with Vision Language Models](https://arxiv.org/abs/2407.01449) and first released in [this repository](https://github.com/ManuelFay/colpali)
|
17 |
|
|
|
18 |
<p align="center"><img width=800 src="https://github.com/illuin-tech/colpali/blob/main/assets/colpali_architecture.webp?raw=true"/></p>
|
19 |
|
20 |
## Version specificity
|