Hugging Face's logo

LinkSoul
/
Chinese-LLaVA-Cllama2

Text Generation
Transformers
PyTorch
Chinese
English
llava
Inference Endpoints
Model card Files Community
1
Chinese-LLaVA-Cllama2
File size: 2,339 Bytes 
0cfa61b
75b6b62
 
 
 
 
 
 
0cfa61b
75b6b62
 
 
 
 
 
 
 
 
 
 
16af6fa
75b6b62
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4f4de1d
 
 
 
8e97ccc
 
 
 
75b6b62
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
 
---
license: openrail

datasets:
- LinkSoul/Chinese-LLaVA-Vision-Instructions
language:
- zh
- en
---


# Chinese LLaVA

开源，可商用的**中英文双语视觉-语言助手 Chinese-LLaVA 以及中英文视觉 SFT 数据集 Chinese-LLaVA-Vision-Instructions**，支持中英文视觉-文本多模态对话的开源可商用对话模型。

<!--
<p align="center">
    <img src="meta/preview.jpg" width="40%">
</p>
-->
![Chinese-LLaVA](meta/chinese_llava_preview.jpg)

## 基础演示

![Base Demo](meta/demo.gif)

## 在线试玩

> Talk is cheap, Show you the Demo.
- [Demo 地址 / HuggingFace Spaces](https://huggingface.co/spaces/LinkSoul/Chinese-LLaVA) 

## 资源下载

- 模型：
  - [Chinese-LLaVA-Chinese-Llama-2-7B](https://huggingface.co/LinkSoul/Chinese-LLaVA-Cllama2)
  - [Chinese-LLaVA-Baichuan-7B](https://huggingface.co/LinkSoul/Chinese-LLaVA-Baichuan)

- 百度网盘下载:
  - [Chinese-LLaVA-Chinese-Llama-2-7B](https://pan.baidu.com/s/16e_LEacMy2bqOYanIFWy8Q?pwd=9j61)
  - [Chinese-LLaVA-Baichuan-7B](https://pan.baidu.com/s/1WuYPrIaul0i6KA-to98cHw?pwd=6jwz)

- 语言模型:
  - [Chinese-Llama-2-7b](https://github.com/LinkSoul-AI/Chinese-Llama-2-7b)
  - [Baichuan-7B](https://huggingface.co/baichuan-inc/Baichuan-7B)

- 数据集：[Chinese-LLaVA-Vision-Instructions](https://huggingface.co/datasets/LinkSoul/Chinese-LLaVA-Vision-Instructions)

## 环境安装
```shell
# clone the repository
git clone https://github.com/LinkSoul-AI/Chinese-LLaVA
cd Chinese-LLaVA

# install package
conda create -n Cllava python=3.10 -y
conda activate Cllava
pip install --upgrade pip
pip install -e .
```

## 快速测试

```shell
python infer.py \
    --model-name PATH/TO/THE/CHINESE_LLAVA_MODEL \
    --llm-type "Chinese_llama2" or "baichuan" \
    --image-file PATH/TO/THE/INPUT/IMAGE \
    --query QUERY/PROMPT
```

## TODO
- 如何训练
- int4 量化
- docker 部署

## 相关项目

- [LLaVA](https://llava-vl.github.io/)
- [Chinese-Llama-2-7B](https://huggingface.co/LinkSoul/Chinese-Llama-2-7b)
- [baichuan-inc/Baichuan-7B](https://huggingface.co/baichuan-inc/Baichuan-7B)


## 项目协议

[Apache-2.0 license](https://github.com/LinkSoul-AI/Chinese-LLaVA/blob/main/LICENSE)

## 微信交流群
<!--
<img src=".github/QRcode.jpg" alt="微信交流群" width="300"/>
-->
欢迎加入[微信群](meta/QRcode.jpg)