Hugging Face's logo

c01zaut
/
Qwen2.5-Coder-1.5B-Instruct-rk3588-1.1.4

Text Generation
Transformers
English
qwen2
code
codeqwen
chat
qwen
qwen-coder
conversational
Inference Endpoints
Model card Files Community
c01zaut commited on
Commit
a3dcbce
·
verified ·
1 Parent(s): 3bf3291

Upload folder using huggingface_hub

Browse files
Files changed (20) hide show
  1. .gitattributes +12 -0
  2. Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8-opt-0-hybrid-ratio-0.0.rkllm +1 -1
  3. Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8-opt-0-hybrid-ratio-0.5.rkllm +1 -1
  4. Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8-opt-0-hybrid-ratio-1.0.rkllm +1 -1
  5. Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8-opt-1-hybrid-ratio-0.0.rkllm +1 -1
  6. Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8-opt-1-hybrid-ratio-0.5.rkllm +1 -1
  7. Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8-opt-1-hybrid-ratio-1.0.rkllm +1 -1
  8. Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.0.rkllm +3 -0
  9. Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.5.rkllm +3 -0
  10. Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-1.0.rkllm +3 -0
  11. Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.0.rkllm +3 -0
  12. Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.5.rkllm +3 -0
  13. Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-1.0.rkllm +3 -0
  14. Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.0.rkllm +3 -0
  15. Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.5.rkllm +3 -0
  16. Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-1.0.rkllm +3 -0
  17. Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.0.rkllm +3 -0
  18. Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.5.rkllm +3 -0
  19. Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-1.0.rkllm +3 -0
  20. README.md +1 -1
.gitattributes CHANGED
@@ -39,3 +39,15 @@ Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8-opt-0-hybrid-ratio-1.0.rkllm filter=lfs
39
  Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8-opt-1-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
40
  Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8-opt-1-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
41
  Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8-opt-1-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
39
  Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8-opt-1-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
40
  Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8-opt-1-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
41
  Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8-opt-1-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
42
+ Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
43
+ Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
44
+ Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
45
+ Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
46
+ Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
47
+ Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
48
+ Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
49
+ Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
50
+ Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
51
+ Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
52
+ Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
53
+ Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8-opt-0-hybrid-ratio-0.0.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:64bb0519638a93c1b08fb6a737974d7cdeafc2d71a5596a45dc3ac8c29f3b8f1
3
  size 2035400284
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7210d02594c920e2d98fcf5dc1ec433b37e94f3cea78457f235fc48abf43baee
3
  size 2035400284
Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8-opt-0-hybrid-ratio-0.5.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:64bb0519638a93c1b08fb6a737974d7cdeafc2d71a5596a45dc3ac8c29f3b8f1
3
  size 2035400284
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7210d02594c920e2d98fcf5dc1ec433b37e94f3cea78457f235fc48abf43baee
3
  size 2035400284
Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8-opt-0-hybrid-ratio-1.0.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:64bb0519638a93c1b08fb6a737974d7cdeafc2d71a5596a45dc3ac8c29f3b8f1
3
  size 2035400284
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7210d02594c920e2d98fcf5dc1ec433b37e94f3cea78457f235fc48abf43baee
3
  size 2035400284
Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8-opt-1-hybrid-ratio-0.0.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:769f51f51d9283d05a4b687e0a9d3d08f4a63bbf4cb5e059d5369b0327f1b3df
3
  size 2035400284
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:726837136feec5c7e1f5db7f7fcbc26d3b974b890e9014faeba402875e229af8
3
  size 2035400284
Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8-opt-1-hybrid-ratio-0.5.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:769f51f51d9283d05a4b687e0a9d3d08f4a63bbf4cb5e059d5369b0327f1b3df
3
  size 2035400284
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:726837136feec5c7e1f5db7f7fcbc26d3b974b890e9014faeba402875e229af8
3
  size 2035400284
Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8-opt-1-hybrid-ratio-1.0.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:769f51f51d9283d05a4b687e0a9d3d08f4a63bbf4cb5e059d5369b0327f1b3df
3
  size 2035400284
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:726837136feec5c7e1f5db7f7fcbc26d3b974b890e9014faeba402875e229af8
3
  size 2035400284
Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b9f43557e37490e759997e0d422cb9ab531fa0498928221cff2fbc4471a1a0ae
3
+ size 2154643444
Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.5.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b9f43557e37490e759997e0d422cb9ab531fa0498928221cff2fbc4471a1a0ae
3
+ size 2154643444
Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g128-opt-0-hybrid-ratio-1.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b9f43557e37490e759997e0d422cb9ab531fa0498928221cff2fbc4471a1a0ae
3
+ size 2154643444
Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6acb8494c41ab41ee805774d3e3890bc785cd3248432d18e093e4f7d19b48dff
3
+ size 2140621588
Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.5.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6acb8494c41ab41ee805774d3e3890bc785cd3248432d18e093e4f7d19b48dff
3
+ size 2140621588
Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g128-opt-1-hybrid-ratio-1.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6acb8494c41ab41ee805774d3e3890bc785cd3248432d18e093e4f7d19b48dff
3
+ size 2140621588
Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:656836f8142a1a53e9a008eaafaad2beab6dd45bff542ada03981744dd8b3e86
3
+ size 2092226260
Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.5.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:656836f8142a1a53e9a008eaafaad2beab6dd45bff542ada03981744dd8b3e86
3
+ size 2092226260
Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g256-opt-0-hybrid-ratio-1.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:656836f8142a1a53e9a008eaafaad2beab6dd45bff542ada03981744dd8b3e86
3
+ size 2092226260
Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:75fed71133686c90c071a6917255cab794f67c095145b09139231653c149cadd
3
+ size 2085841492
Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.5.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:75fed71133686c90c071a6917255cab794f67c095145b09139231653c149cadd
3
+ size 2085841492
Qwen2.5-Coder-1.5B-Instruct-rk3588-w8a8_g256-opt-1-hybrid-ratio-1.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:75fed71133686c90c071a6917255cab794f67c095145b09139231653c149cadd
3
+ size 2085841492
README.md CHANGED
@@ -16,7 +16,7 @@ tags:
16
  ---
17
  # Qwen2.5-Coder-1.5B-Instruct-RK3588-1.1.2
18
 
19
- This version of Qwen2.5-Coder-1.5B-Instruct has been converted to run on the RK3588 NPU using ['w8a8'] quantization.
20
  This model has been optimized with the following LoRA:
21
 
22
  Compatible with RKLLM version: 1.1.2
 
16
  ---
17
  # Qwen2.5-Coder-1.5B-Instruct-RK3588-1.1.2
18
 
19
+ This version of Qwen2.5-Coder-1.5B-Instruct has been converted to run on the RK3588 NPU using ['w8a8', 'w8a8_g128', 'w8a8_g256', 'w8a8_g512'] quantization.
20
  This model has been optimized with the following LoRA:
21
 
22
  Compatible with RKLLM version: 1.1.2