Hugging Face's logo

nitky
/
Megac4ai-command-r-plus-gguf

Text Generation
GGUF
mergekit
Merge
Inference Endpoints
Model card Files Community
nitky commited on
Commit
7c54bb2
•
1 Parent(s): 548f755

Upload folder using huggingface_hub

Browse files
Files changed (26) hide show
  1. .gitattributes +24 -0
  2. Megac4ai-command-r-plus-IQ3_XS-00001-of-00002.gguf +3 -0
  3. Megac4ai-command-r-plus-IQ3_XS-00002-of-00002.gguf +3 -0
  4. Megac4ai-command-r-plus-IQ4_XS-00001-of-00002.gguf +3 -0
  5. Megac4ai-command-r-plus-IQ4_XS-00002-of-00002.gguf +3 -0
  6. Megac4ai-command-r-plus-Q4_K_M-00001-of-00003.gguf +3 -0
  7. Megac4ai-command-r-plus-Q4_K_M-00002-of-00003.gguf +3 -0
  8. Megac4ai-command-r-plus-Q4_K_M-00003-of-00003.gguf +3 -0
  9. Megac4ai-command-r-plus-Q5_K_M-00001-of-00003.gguf +3 -0
  10. Megac4ai-command-r-plus-Q5_K_M-00002-of-00003.gguf +3 -0
  11. Megac4ai-command-r-plus-Q5_K_M-00003-of-00003.gguf +3 -0
  12. Megac4ai-command-r-plus-Q6_K-00001-of-00003.gguf +3 -0
  13. Megac4ai-command-r-plus-Q6_K-00002-of-00003.gguf +3 -0
  14. Megac4ai-command-r-plus-Q6_K-00003-of-00003.gguf +3 -0
  15. Megac4ai-command-r-plus-Q8_0-00001-of-00004.gguf +3 -0
  16. Megac4ai-command-r-plus-Q8_0-00002-of-00004.gguf +3 -0
  17. Megac4ai-command-r-plus-Q8_0-00003-of-00004.gguf +3 -0
  18. Megac4ai-command-r-plus-Q8_0-00004-of-00004.gguf +3 -0
  19. Megac4ai-command-r-plus-f16-00001-of-00007.gguf +3 -0
  20. Megac4ai-command-r-plus-f16-00002-of-00007.gguf +3 -0
  21. Megac4ai-command-r-plus-f16-00003-of-00007.gguf +3 -0
  22. Megac4ai-command-r-plus-f16-00004-of-00007.gguf +3 -0
  23. Megac4ai-command-r-plus-f16-00005-of-00007.gguf +3 -0
  24. Megac4ai-command-r-plus-f16-00006-of-00007.gguf +3 -0
  25. Megac4ai-command-r-plus-f16-00007-of-00007.gguf +3 -0
  26. README.md +32 -0
.gitattributes CHANGED
@@ -33,3 +33,27 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Megac4ai-command-r-plus-IQ3_XS-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Megac4ai-command-r-plus-IQ3_XS-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Megac4ai-command-r-plus-IQ4_XS-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Megac4ai-command-r-plus-IQ4_XS-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Megac4ai-command-r-plus-Q4_K_M-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Megac4ai-command-r-plus-Q4_K_M-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Megac4ai-command-r-plus-Q4_K_M-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Megac4ai-command-r-plus-Q5_K_M-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Megac4ai-command-r-plus-Q5_K_M-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Megac4ai-command-r-plus-Q5_K_M-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Megac4ai-command-r-plus-Q6_K-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Megac4ai-command-r-plus-Q6_K-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Megac4ai-command-r-plus-Q6_K-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
49
+ Megac4ai-command-r-plus-Q8_0-00001-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
50
+ Megac4ai-command-r-plus-Q8_0-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
51
+ Megac4ai-command-r-plus-Q8_0-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
52
+ Megac4ai-command-r-plus-Q8_0-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
53
+ Megac4ai-command-r-plus-f16-00001-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
54
+ Megac4ai-command-r-plus-f16-00002-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
55
+ Megac4ai-command-r-plus-f16-00003-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
56
+ Megac4ai-command-r-plus-f16-00004-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
57
+ Megac4ai-command-r-plus-f16-00005-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
58
+ Megac4ai-command-r-plus-f16-00006-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
59
+ Megac4ai-command-r-plus-f16-00007-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
Megac4ai-command-r-plus-IQ3_XS-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52b9c4232a3ee69ef5ad4af191e00440dab31563d662ae424bda260a39e1cccf
3
+ size 48250710432
Megac4ai-command-r-plus-IQ3_XS-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b91f1eb526fbc8f2f5983691b26cfa694b6f1a36210aeacefed103d880516334
3
+ size 18415702688
Megac4ai-command-r-plus-IQ4_XS-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:30c02e30507142379257ad8e18c4be43892a834fc0ae5bb5ebb42de24ce23206
3
+ size 48117120384
Megac4ai-command-r-plus-IQ4_XS-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e57885548de67ebf8b2fed7ea780719ef2e5d42cd1db94b0f4a9e72232015918
3
+ size 39018151584
Megac4ai-command-r-plus-Q4_K_M-00001-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2bc3a522a5c02e2080a1d39039e3ea7cd9723ef408408e64e80c6013c7a3bd02
3
+ size 48177991680
Megac4ai-command-r-plus-Q4_K_M-00002-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ea2417db970ae2b7e422a33b306ca72afeb37a134ac046465661efb3e21f277
3
+ size 48316853120
Megac4ai-command-r-plus-Q4_K_M-00003-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e2fc5fea7b2d3c6d86cddd5795d40f7dd095ae76689f2f60763a31e20f32387
3
+ size 95306016
Megac4ai-command-r-plus-Q5_K_M-00001-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9099733382a3fb267e502a6c594c6f903b60bcc3b38b6f9282026f7db63b6cc0
3
+ size 48123944672
Megac4ai-command-r-plus-Q5_K_M-00002-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2325586c6896bf39562924744b08807daa2fc57dc5cc15e957df2a46b5b91b86
3
+ size 48157621184
Megac4ai-command-r-plus-Q5_K_M-00003-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e49579a67bfc675382a41c5ea049f79abfdeb39ac59e7d9abe5a752ae996552
3
+ size 17295516192
Megac4ai-command-r-plus-Q6_K-00001-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fb371ae7f67f633c553e80686e7f1836777a87244a3892370602e85135b7ffd0
3
+ size 48228217120
Megac4ai-command-r-plus-Q6_K-00002-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c86b9007e084d67b3a11aa5a54427f3502d77a57cb5e13c49c331d4c175713da
3
+ size 48145402848
Megac4ai-command-r-plus-Q6_K-00003-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4a8e7f2a8e8b3dd633822f1ed35eda6c0916d94ec084098a83e8ef62a80bb093
3
+ size 35252076448
Megac4ai-command-r-plus-Q8_0-00001-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd58752eba5881073fe312e8293c1e96735456b5b9702c4bf4b7228253990b44
3
+ size 47942852096
Megac4ai-command-r-plus-Q8_0-00002-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:515993b665dcd8f978dca1d64056a4e40a34fafb221efe4257b7dc39a4c71f3e
3
+ size 48292910304
Megac4ai-command-r-plus-Q8_0-00003-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:be1f23f25fc9671dc67362a9d2d90ef7b013e1c5b5f77ccd15fa5426a668bf99
3
+ size 48039089728
Megac4ai-command-r-plus-Q8_0-00004-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ee49164c614966b01f6f755525450125696a36de83bbbb542586522c33111dc
3
+ size 26205500416
Megac4ai-command-r-plus-f16-00001-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3949fe8f84ded6955252d6ca1ce92ad427aee40bbca7c9144d3e5d73182fc8a4
3
+ size 47500270624
Megac4ai-command-r-plus-f16-00002-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:65e10b1dbdcffd4c4cd1428dd364f4b2732350315ed2fe6791e248bc14cfaa72
3
+ size 48194102880
Megac4ai-command-r-plus-f16-00003-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7bc231eb306fc3f50e8db882aeaccb1714eb45adaa37f89d1a8201c105d6dc83
3
+ size 48017835008
Megac4ai-command-r-plus-f16-00004-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec05152a6736331333b8f2196f2978656a666bae949c08da0411a7cdbc5256f6
3
+ size 47841879584
Megac4ai-command-r-plus-f16-00005-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cc562cd5f309404abb889e6751b1f52477618bbb174449d3a27860b4afb5d19f
3
+ size 48194200768
Megac4ai-command-r-plus-f16-00006-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63b595a1fa41a6a180548cc6d7ee311b16a12fc01cfba17015e2fead4ba52253
3
+ size 48017884192
Megac4ai-command-r-plus-f16-00007-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52af8aaac569f38092ca99e40934324029ebe581e3a258f2b40c173784c13eb2
3
+ size 33119299808
README.md CHANGED
@@ -1,3 +1,35 @@
1
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  license: cc-by-nc-4.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ base_model:
3
+ - CohereForAI/c4ai-command-r-plus
4
+ library_name: gguf
5
+ tags:
6
+ - mergekit
7
+ - merge
8
+ language:
9
+ - en
10
+ - fr
11
+ - de
12
+ - es
13
+ - it
14
+ - pt
15
+ - ja
16
+ - ko
17
+ - zh
18
+ - ar
19
+ pipeline_tag: text-generation
20
  license: cc-by-nc-4.0
21
  ---
22
+ # Megac4ai-command-r-plus-gguf
23
+
24
+ These are quantized GGUF versions of [nitky/Megac4ai-command-r-plus](https://huggingface.co/nitky/Megac4ai-command-r-plus). Please check the original model for license and more details.
25
+
26
+ ## Results for non-English languages (Japanese)
27
+
28
+ | Model | Output Quality | Notes |
29
+ |-------|----------------|-------|
30
+ | Megac4ai-command-r-plus-IQ3_XS.gguf | Poor | |
31
+ | Megac4ai-command-r-plus-IQ4_XS.gguf | Average | |
32
+ | Megac4ai-command-r-plus-Q4_K_M.gguf | Good | recommended |
33
+ | Megac4ai-command-r-plus-Q5_K_M.gguf | Good | |
34
+ | Megac4ai-command-r-plus-Q6_K.gguf | Excellent | recommended |
35
+ | Megac4ai-command-r-plus-Q8_0.gguf | Excellent | |