File size: 1,577 Bytes
4dd036e 738e435 4dd036e 738e435 4dd036e 738e435 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 |
---
title: ColPali
app_file: app.py
sdk: gradio
sdk_version: 4.41.0
---
# RAG-based PDF Search and Keyword Extraction using Qwen2VL
This repository contains an implementation of a **RAG (Retrieval-Augmented Generation)** based PDF search system using **Copali's implementation** of the Byaldi library and **Qwen2VL** for creating the RAG pipeline. Additionally, the repository includes a Gradio app that allows users to extract text from images and highlight searched keywords using **Qwen2VL**.
## Table of Contents
- [Overview](#overview)
- [Installation](#installation)
- [Usage](#usage)
- [RAG PDF Search](#rag-pdf-search)
- [Gradio App for Keyword Extraction](#gradio-app-for-keyword-extraction)
- [License](#license)
## Overview
### RAG PDF Search
In `copali-qwen.ipynb`, you will find the complete implementation of the **RAG-based PDF search**. The pipeline is built using the **Copali** implementation of the Byaldi library, along with **Qwen2VL**. By default, the code indexes and searches through an image (`image.png`), but you can easily modify the path to a PDF file or any other desired document.
### Gradio App for Keyword Extraction
The `app.py` file contains a **Gradio app** that utilizes only **Qwen2VL** to extract text from an image and highlight the keywords matching the user's search query. This app is an easy-to-use interface for real-time keyword extraction from images.
## Installation
To run this project, you will need to install the following dependencies:
```bash
pip install transformers byaldi qwen-vl-utils gradio pillow torch
|