Hugging Face's logo

taobao-mnn
/
gemma-2-9b-it-MNN

Text Generation
English
chat
Model card Files Community
zhaode commited on
Commit
8db5d0a
·
verified ·
1 Parent(s): df3a5a2

Upload folder using huggingface_hub

Browse files
Files changed (2) hide show
  1. .gitattributes +37 -40
  2. README.md +42 -42
.gitattributes CHANGED
@@ -1,41 +1,38 @@
1
  *.7z filter=lfs diff=lfs merge=lfs -text
2
- *.arrow filter=lfs diff=lfs merge=lfs -text
3
- *.bin filter=lfs diff=lfs merge=lfs -text
4
- *.bin.* filter=lfs diff=lfs merge=lfs -text
5
- *.bz2 filter=lfs diff=lfs merge=lfs -text
6
- *.ftz filter=lfs diff=lfs merge=lfs -text
7
- *.gz filter=lfs diff=lfs merge=lfs -text
8
- *.h5 filter=lfs diff=lfs merge=lfs -text
9
- *.joblib filter=lfs diff=lfs merge=lfs -text
10
- *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
- *.model filter=lfs diff=lfs merge=lfs -text
12
- *.msgpack filter=lfs diff=lfs merge=lfs -text
13
- *.onnx filter=lfs diff=lfs merge=lfs -text
14
- *.ot filter=lfs diff=lfs merge=lfs -text
15
- *.parquet filter=lfs diff=lfs merge=lfs -text
16
- *.pb filter=lfs diff=lfs merge=lfs -text
17
- *.pt filter=lfs diff=lfs merge=lfs -text
18
- *.pth filter=lfs diff=lfs merge=lfs -text
19
- *.rar filter=lfs diff=lfs merge=lfs -text
20
- saved_model/**/* filter=lfs diff=lfs merge=lfs -text
21
- *.tar.* filter=lfs diff=lfs merge=lfs -text
22
- *.tflite filter=lfs diff=lfs merge=lfs -text
23
- *.tgz filter=lfs diff=lfs merge=lfs -text
24
- *.xz filter=lfs diff=lfs merge=lfs -text
25
- *.zip filter=lfs diff=lfs merge=lfs -text
26
- *.zstandard filter=lfs diff=lfs merge=lfs -text
27
- *.tfevents* filter=lfs diff=lfs merge=lfs -text
28
- *.db* filter=lfs diff=lfs merge=lfs -text
29
- *.ark* filter=lfs diff=lfs merge=lfs -text
30
- **/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
31
- **/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
32
- **/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
33
- *.safetensors filter=lfs diff=lfs merge=lfs -text
34
- *.ckpt filter=lfs diff=lfs merge=lfs -text
35
- *.mnn filter=lfs diff=lfs merge=lfs -text
36
- *.mnn.* filter=lfs diff=lfs merge=lfs -text
37
- *.weight filter=lfs diff=lfs merge=lfs -text
38
- embeddings_bf16.bin filter=lfs diff=lfs merge=lfs -text
39
- llm.mnn filter=lfs diff=lfs merge=lfs -text
40
- llm.mnn.json filter=lfs diff=lfs merge=lfs -text
41
- llm.mnn.weight filter=lfs diff=lfs merge=lfs -text
 
1
  *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bin.* filter=lfs diff=lfs merge=lfs -text
5
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.model filter=lfs diff=lfs merge=lfs -text
12
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
13
+ *.onnx filter=lfs diff=lfs merge=lfs -text
14
+ *.ot filter=lfs diff=lfs merge=lfs -text
15
+ *.parquet filter=lfs diff=lfs merge=lfs -text
16
+ *.pb filter=lfs diff=lfs merge=lfs -text
17
+ *.pt filter=lfs diff=lfs merge=lfs -text
18
+ *.pth filter=lfs diff=lfs merge=lfs -text
19
+ *.rar filter=lfs diff=lfs merge=lfs -text
20
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
21
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
22
+ *.tflite filter=lfs diff=lfs merge=lfs -text
23
+ *.tgz filter=lfs diff=lfs merge=lfs -text
24
+ *.xz filter=lfs diff=lfs merge=lfs -text
25
+ *.zip filter=lfs diff=lfs merge=lfs -text
26
+ *.zstandard filter=lfs diff=lfs merge=lfs -text
27
+ *.tfevents* filter=lfs diff=lfs merge=lfs -text
28
+ *.db* filter=lfs diff=lfs merge=lfs -text
29
+ *.ark* filter=lfs diff=lfs merge=lfs -text
30
+ **/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
31
+ **/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
32
+ **/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
33
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
34
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
35
+ *.mnn filter=lfs diff=lfs merge=lfs -text
36
+ *.mnn.* filter=lfs diff=lfs merge=lfs -text
37
+ *.weight filter=lfs diff=lfs merge=lfs -text
38
+
 
 
 
README.md CHANGED
@@ -1,51 +1,51 @@
1
  ---
2
- license: apache-2.0
3
- language:
4
- - en
5
- pipeline_tag: text-generation
6
- tags:
7
- - chat
8
- ---
9
- # gemma-2-9b-it-MNN
10
 
11
- ## Introduction
12
- This model is a 4-bit quantized version of the MNN model exported from /home/yanxing/model/public-mnn/gemma-2-9b-it using [llmexport](https://github.com/alibaba/MNN/tree/master/transformers/llm/export).
13
 
14
- ## Download
15
- ```bash
16
- # install huggingface
17
- pip install huggingface
18
- ```
19
- ```bash
20
- # shell download
21
- huggingface download --model 'taobao-mnn/gemma-2-9b-it-MNN' --local_dir 'path/to/dir'
22
- ```
23
- ```python
24
- # SDK download
25
- from huggingface_hub import snapshot_download
26
- model_dir = snapshot_download('taobao-mnn/gemma-2-9b-it-MNN')
27
- ```
28
 
29
- ```bash
30
- # git clone
31
- git clone https://www.modelscope.cn/taobao-mnn/gemma-2-9b-it-MNN
32
- ```
33
 
34
- ## Usage
35
- ```bash
36
- # clone MNN source
37
- git clone https://github.com/alibaba/MNN.git
38
 
39
- # compile
40
- cd MNN
41
- mkdir build && cd build
42
- cmake .. -DMNN_LOW_MEMORY=true -DMNN_CPU_WEIGHT_DEQUANT_GEMM=true -DMNN_BUILD_LLM=true -DMNN_SUPPORT_TRANSFORMER_FUSE=true
43
- make -j
44
 
45
- # run
46
- ./llm_demo /path/to/gemma-2-9b-it-MNN/config.json prompt.txt
47
- ```
48
 
49
- ## Document
50
- [MNN-LLM](https://mnn-docs.readthedocs.io/en/latest/transformers/llm.html#)
51
 
 
1
  ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ pipeline_tag: text-generation
6
+ tags:
7
+ - chat
8
+ ---
9
+ # gemma-2-9b-it-MNN
10
 
11
+ ## Introduction
12
+ This model is a 4-bit quantized version of the MNN model exported from /home/yanxing/model/public-mnn/gemma-2-9b-it using [llmexport](https://github.com/alibaba/MNN/tree/master/transformers/llm/export).
13
 
14
+ ## Download
15
+ ```bash
16
+ # install huggingface
17
+ pip install huggingface
18
+ ```
19
+ ```bash
20
+ # shell download
21
+ huggingface download --model 'taobao-mnn/gemma-2-9b-it-MNN' --local_dir 'path/to/dir'
22
+ ```
23
+ ```python
24
+ # SDK download
25
+ from huggingface_hub import snapshot_download
26
+ model_dir = snapshot_download('taobao-mnn/gemma-2-9b-it-MNN')
27
+ ```
28
 
29
+ ```bash
30
+ # git clone
31
+ git clone https://www.modelscope.cn/taobao-mnn/gemma-2-9b-it-MNN
32
+ ```
33
 
34
+ ## Usage
35
+ ```bash
36
+ # clone MNN source
37
+ git clone https://github.com/alibaba/MNN.git
38
 
39
+ # compile
40
+ cd MNN
41
+ mkdir build && cd build
42
+ cmake .. -DMNN_LOW_MEMORY=true -DMNN_CPU_WEIGHT_DEQUANT_GEMM=true -DMNN_BUILD_LLM=true -DMNN_SUPPORT_TRANSFORMER_FUSE=true
43
+ make -j
44
 
45
+ # run
46
+ ./llm_demo /path/to/gemma-2-9b-it-MNN/config.json prompt.txt
47
+ ```
48
 
49
+ ## Document
50
+ [MNN-LLM](https://mnn-docs.readthedocs.io/en/latest/transformers/llm.html#)
51