ColPali
Safetensors
English
qwen2_5_vl
Markgazol commited on
Commit
4e15d53
·
verified ·
1 Parent(s): 4c12c10

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +40 -0
README.md ADDED
@@ -0,0 +1,40 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - Qwen/Qwen2.5-VL-3B-Instruct
4
+ language:
5
+ - en
6
+ library_name: colpali
7
+ license: apache-2.0
8
+ ---
9
+ # ColQwen2.5: Visual Retriever based on Qwen2.5-VL-3B-Instruct with ColBERT strategy
10
+
11
+ ColQwen is a model based on a novel model architecture and training strategy based on Vision Language Models (VLMs) to efficiently index documents from their visual features.
12
+ It is a [Qwen2.5-VL-3B](https://huggingface.co/Qwen/Qwen2.5-VL-3B-Instruct) extension that generates [ColBERT](https://arxiv.org/abs/2004.12832)- style multi-vector representations of text and images.
13
+ It was introduced in the paper [ColPali: Efficient Document Retrieval with Vision Language Models](https://arxiv.org/abs/2407.01449) and first released in [this repository](https://github.com/ManuelFay/colpali)
14
+
15
+ This version is the untrained base version to guarantee deterministic projection layer initialization.
16
+
17
+
18
+ ## Usage
19
+
20
+ > [!WARNING]
21
+ > This version should not be used: it is solely the base version useful for deterministic LoRA initialization.
22
+
23
+
24
+ ## Citation
25
+
26
+ If you use any datasets or models from this organization in your research, please cite the original dataset as follows:
27
+
28
+ ```bibtex
29
+ @misc{faysse2024colpaliefficientdocumentretrieval,
30
+ title={ColPali: Efficient Document Retrieval with Vision Language Models},
31
+ author={Manuel Faysse and Hugues Sibille and Tony Wu and Bilel Omrani and Gautier Viaud and Céline Hudelot and Pierre Colombo},
32
+ year={2024},
33
+ eprint={2407.01449},
34
+ archivePrefix={arXiv},
35
+ primaryClass={cs.IR},
36
+ url={https://arxiv.org/abs/2407.01449},
37
+ }
38
+ ```
39
+
40
+ Developed by: Metric AI Research Lab