FydeRobot commited on
Commit
12d41c7
·
verified ·
1 Parent(s): 8b43638
Files changed (1) hide show
  1. README.md +78 -49
README.md CHANGED
@@ -11,92 +11,121 @@ tags:
11
  - rk3588
12
  - RockChip
13
  ---
 
14
  # 通义千问-1_8B / Qwen-1_8B-Chat_rkLLM
15
 
 
 
16
 
17
- - [中文](#通义千问-1_8b)
18
- - [English](#qwen-1_8b-chat_rkllm)
19
  ## 通义千问-1_8B
 
20
  ### 介绍
21
- 这是从 [Qwen-1_8B](https://huggingface.co/Qwen/Qwen-1_8B/) 转换而来的RKLLM模型,用于Rockchip设备的转换模型。
22
- 该模型运行在RK3588的NPU上。
23
 
24
  - **模型名称**: Qwen-1_8B
25
- - **模型架构**: Qwen-1_8B
26
  - **发布者**: FydeOS
27
- - **日期**: 2024-05-14
28
 
29
  ### 模型详情
30
- 通义千问-1.8B(Qwen-1.8B)是阿里云研发的通义千问大模型系列的18亿参数规模的模型。Qwen-1.8B是基于Transformer的大语言模型, 在超大规模的预训练数据上进行训练得到。预训练数据类型多样,覆盖广泛,包括大量网络文本、专业书籍、代码等。
31
-
32
- ### 要求
33
 
 
34
 
35
  ### 使用指南
36
- > 本模型仅支持运行在搭载 rk3588 芯片的相关设备,请确认芯片信息并保证 npu 可用
37
- #### OpenFyde 系统
38
- > ⚠️:请确认你已经升级到openfyde的最新版本
39
- - 点击下载模型文件 `XXX.rkllm`
40
- - 新建文件夹 `model/` ,将模型文件放置在此文件夹下
41
- - 启动 FydeOS AI ,在设置页面进行相关设置
42
 
43
- #### OpenFyde 系统
44
- > ⚠️:请确认你进行了 rkllm 的 npu 相关内核更新
45
- - 点击下载模型文件 `XXX.rkllm`
46
- - 参考官方文档进行配置:[官方文档](https://github.com/airockchip/rknn-llm)
 
 
 
 
 
 
 
47
 
48
- ### FAQ
49
- 如遇到问题,敬请查阅issue区,如仍无法解决再提交issue。
 
 
 
 
 
 
50
 
51
  ### 限制与注意事项
52
- 说明模型的局限性和使用中的注意事项。
 
 
 
53
 
54
  ### 许可证
55
- 采用与[Qwen-1_8B](https://huggingface.co/Qwen/Qwen-1_8B/)相同的许可证。
 
56
 
57
  ### 联系方式
 
58
  如需更多信息,请联系:
 
59
  - **电子邮件**: [email protected]
60
  - **主页**: [FydeOS AI](https://fydeos.ai/zh/)
61
 
 
 
62
  ## Qwen-1_8B-Chat_rkLLM
63
 
64
- ### Introduction
65
- This is a conversion from [Qwen-1_8B](https://huggingface.co/Qwen/Qwen-1_8B/) to the RKLLM format for Rockchip devices. The model runs on the NPU from RK3588.
 
66
 
67
  - **Model Name**: Qwen-1_8B
68
- - **Model Architecture**: Same as Qwen-1_8B
69
  - **Publisher**: FydeOS
70
- - **Date**: 2024-05-14
 
 
 
 
 
 
 
 
 
 
71
 
72
- ### Model Details
73
- The Qwen-1.8B model, part of Alibaba Cloud's larger Qwen model series, has 1.8 billion parameters. It is a large language model based on the Transformer architecture, trained on a vast and varied dataset including extensive internet text, professional literature, and code.
74
 
75
- ### Requirements
 
 
76
 
77
- ### Usage Guide
78
- > This model is only supported on devices equipped with the RK3588 chip. Ensure that the chip and NPU are available.
79
- #### For OpenFyde Systems
80
- > ⚠️: Please make sure you have upgraded to the latest version of OpenFyde.
81
- - Click to download the model file `XXX.rkllm`.
82
- - Create a new folder `model/` and place the model file in this folder.
83
- - Start FydeOS AI and make the necessary settings on the settings page.
84
 
85
- #### For Non-OpenFyde Systems
86
- > ⚠️: Ensure you have updated the NPU related kernel for rkllm.
87
- - Click to download the model file `XXX.rkllm`.
88
- - Refer to the official documentation for setup: [Official Documentation](https://github.com/airockchip/rknn-llm)
89
 
90
- ### FAQ
91
- Please consult the issue section for any problems, and submit a new issue if the problem remains unsolved.
92
 
93
- ### Limitations and Precautions
94
- Details on the limitations and precautions to consider when using the model.
95
 
96
- ### License
97
- Uses the same license as [Qwen-1_8B](https://huggingface.co/Qwen/Qwen-1_8B/).
 
 
 
 
 
 
 
 
 
 
 
98
 
99
- ### Contact Information
100
  For more information, please contact:
 
101
  - **Email**: [email protected]
102
- - **Homepage**: [FydeOS AI](https://fydeos.ai/zh/)
 
 
11
  - rk3588
12
  - RockChip
13
  ---
14
+
15
  # 通义千问-1_8B / Qwen-1_8B-Chat_rkLLM
16
 
17
+ - [中文](#通义千问-1_8B)
18
+ - [English](#Qwen-1_8B-Chat_rkLLM)
19
 
 
 
20
  ## 通义千问-1_8B
21
+
22
  ### 介绍
23
+
24
+ 通义千问-1_8B 是从 [Qwen-1_8B](https://huggingface.co/Qwen/Qwen-1_8B/) 转换而来的 RKLLM 模型,专为 Rockchip 设备优化。该模型运行于 RK3588 NPU 上。
25
 
26
  - **模型名称**: Qwen-1_8B
27
+ - **模型架构**: Qwen-1_8B 相同
28
  - **发布者**: FydeOS
29
+ - **发布日期**: 2024-05-14
30
 
31
  ### 模型详情
 
 
 
32
 
33
+ 通义千问-1_8B(Qwen-1_8B)是阿里云研发的通义千问系列大模型中的一员,拥有 18 亿参数。该模型基于 Transformer 架构,经过大规模预训练,涵盖了多种类型的数据,包括网络文本、专业书籍和代码。
34
 
35
  ### 使用指南
 
 
 
 
 
 
36
 
37
+ > 本模型仅支持在搭载 Rockcip RK3588/s 芯片的设备上运行,请确认设备芯片信息并确保 NPU 可用。
38
+
39
+ #### openFyde 系统
40
+
41
+ > ⚠️ 请确保你已将系统升级到最新版本。
42
+
43
+ 1. 下载模型文件 `XXX.rkllm`。
44
+ 2. 新建文件夹 `model/`,将模型文件放置于该文件夹内。
45
+ 3. 启动 FydeOS AI,在设置页面进行相关配置。
46
+
47
+ #### 其它系统
48
 
49
+ > ⚠️ 请确保已完成 RKLLM 的 NPU 相关内核更新。
50
+
51
+ 1. 下载模型文件 `XXX.rkllm`。
52
+ 2. 按照官方文档进行配置:[官方文档](https://github.com/airockchip/rknn-llm)。
53
+
54
+ ### 常见问题(FAQ)
55
+
56
+ 如遇到问题,请先查阅 issue 区,若问题仍未解决,再提交新的 issue。
57
 
58
  ### 限制与注意事项
59
+
60
+ - 模型在某些情况下可能存在性能限制
61
+ - 使用时请遵循相关法律法规
62
+ - 可能需要进行适当的参数调优以达到最佳效果
63
 
64
  ### 许可证
65
+
66
+ 本模型采用与 [Qwen-1_8B](https://huggingface.co/Qwen/Qwen-1_8B/) 相同的许可证。
67
 
68
  ### 联系方式
69
+
70
  如需更多信息,请联系:
71
+
72
  - **电子邮件**: [email protected]
73
  - **主页**: [FydeOS AI](https://fydeos.ai/zh/)
74
 
75
+
76
+
77
  ## Qwen-1_8B-Chat_rkLLM
78
 
79
+ ## Introduction
80
+
81
+ Qwen-1_8B-Chat_rkLLM is a model converted from [Qwen-1_8B](https://huggingface.co/Qwen/Qwen-1_8B/), specifically designed for Rockchip devices. This model operates on the NPU of the RK3588 chip.
82
 
83
  - **Model Name**: Qwen-1_8B
84
+ - **Architecture**: Identical to Qwen-1_8B
85
  - **Publisher**: FydeOS
86
+ - **Release Date**: 14 May 2024
87
+
88
+ ## Model Details
89
+
90
+ Qwen-1_8B-Chat_rkLLM is part of the Tongyi Qianwen series developed by Alibaba Cloud. This large language model features 1.8 billion parameters and is based on the Transformer architecture. It has been pre-trained on a vast and diverse dataset, including web texts, professional literature, and code.
91
+
92
+ ## User Guide
93
+
94
+ > This model is only supported on devices with the Rockchip RK3588/s chip. Please verify your device’s chip information and ensure the NPU is operational.
95
+
96
+ ### openFyde System
97
 
98
+ > ⚠️ Ensure you have upgraded to the latest version of openFyde.
 
99
 
100
+ 1. Download the model file `XXX.rkllm`.
101
+ 2. Create a folder named `model/` and place the model file inside this folder.
102
+ 3. Launch FydeOS AI and configure the settings on the settings page.
103
 
104
+ ### Other Systems
 
 
 
 
 
 
105
 
106
+ > ⚠️ Ensure you have updated the NPU kernel related to RKLLM.
 
 
 
107
 
108
+ 1. Download the model file `XXX.rkllm`.
109
+ 2. Follow the configuration guidelines provided in the [official documentation](https://github.com/airockchip/rknn-llm).
110
 
111
+ ## FAQ
 
112
 
113
+ For issues, please refer to the issue section. If your problem remains unresolved, submit a new issue.
114
+
115
+ ## Limitations and Considerations
116
+
117
+ - The model may have performance limitations in certain scenarios.
118
+ - Ensure compliance with relevant laws and regulations during usage.
119
+ - Parameter tuning might be necessary to achieve optimal performance.
120
+
121
+ ## Licence
122
+
123
+ This model is licensed under the same terms as [Qwen-1_8B](https://huggingface.co/Qwen/Qwen-1_8B/).
124
+
125
+ ## Contact Information
126
 
 
127
  For more information, please contact:
128
+
129
  - **Email**: [email protected]
130
+ - **Homepage**: [FydeOS AI](https://fydeos.ai/en/)
131
+