Finetuning llava

by maghrane - opened Apr 17

Apr 17

Can someone provide me a code or link to fine tune " llava-hf/vip-llava-7b-hf" ?

nielsr

Llava Hugging Face org Apr 18

Hi,

Yes the TRL library includes experimental support to fine-tune LLaVa and friends: https://github.com/huggingface/trl/blob/main/examples/scripts/vsft_llava.py

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment