Hugging Face's logo

nintwentydo
/
dolphin-vision-72b-3.5bpw-h6-exl2

Safetensors
llava-qwen2
custom_code
exl2
Model card Files Community
dolphin-vision-72b-3.5bpw-h6-exl2 / README.md
nintwentydo's picture
nintwentydo
Upload folder using huggingface_hub
1ea73b3 verified
preview code
|
raw
history blame contribute delete
862 Bytes
metadata
license: other
license_name: tongyi-qianwen
base_model: cognitivecomputations/dolphin-vision-72b
datasets:
  - cognitivecomputations/Dolphin-2.9
  - teknium/OpenHermes-2.5
  - m-a-p/CodeFeedback-Filtered-Instruction
  - cognitivecomputations/dolphin-coder
  - cognitivecomputations/samantha-data
  - microsoft/orca-math-word-problems-200k
  - Locutusque/function-calling-chatml
  - internlm/Agent-FLAN

DolphinVision 72b - 3.5bpw EXL2 🐬

Base model: cognitivecomputations/dolphin-vision-72b

Language model quantized to 3.5bpw with FP16 vision layers merged back in.

Text working in exllamav2/tabbyapi. Vision input not working yet.

n.b. architecture in config.json has been changed from "BunnyQwenForCausalLM" to "Qwen2ForCausalLM" to prevent model from being loaded as llama in tabbyapi.