OnDeviceMedNotes/Endocrinology_transcripts_notes
Viewer
•
Updated
•
925
•
11
•
1
Johnson Thomas PRO
Johnyquest7
AI & ML interests
Medical
Recent Activity
updated
a dataset
9 days ago
OnDeviceMedNotes/Endocrinology_transcripts_notes
updated
a Space
9 days ago
OnDeviceMedNotes/README
updated
a collection
17 days ago
Models to try
Organizations
Johnyquest7's activity
updated
a
dataset
9 days ago
updated
a
Space
9 days ago
updated
a
collection
17 days ago
liked
a
model
23 days ago
liked
a
dataset
23 days ago
updated
a
collection
25 days ago
updated
a
collection
about 2 months ago
updated
2
datasets
4 months ago
upvoted
an
article
4 months ago
Article
Fine-tuning LLMs to 1.58bit: extreme quantization made easy
•
216
reacted to
merve's
post with 🔥
4 months ago
Post
5580
I have put together a notebook on Multimodal RAG, where we do not process the documents with hefty pipelines but natively use:
- vidore/colpali for retrieval 📖 it doesn't need indexing with image-text pairs but just images!
- Qwen/Qwen2-VL-2B-Instruct for generation 💬 directly feed images as is to a vision language model with no processing to text!
I used ColPali implementation of the new 🐭 Byaldi library by @bclavie 🤗
https://github.com/answerdotai/byaldi
Link to notebook: https://github.com/merveenoyan/smol-vision/blob/main/ColPali_%2B_Qwen2_VL.ipynb
- vidore/colpali for retrieval 📖 it doesn't need indexing with image-text pairs but just images!
- Qwen/Qwen2-VL-2B-Instruct for generation 💬 directly feed images as is to a vision language model with no processing to text!
I used ColPali implementation of the new 🐭 Byaldi library by @bclavie 🤗
https://github.com/answerdotai/byaldi
Link to notebook: https://github.com/merveenoyan/smol-vision/blob/main/ColPali_%2B_Qwen2_VL.ipynb
updated
a
collection
5 months ago
liked
2
models
5 months ago
updated
a
model
6 months ago
GGUF file bigger than the original file?
#3 opened 6 months ago
by
Johnyquest7
liked
a
model
6 months ago
