Hugging Face's logo

mradermacher
/
Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1-i1-GGUF

Transformers
GGUF
English
mergekit
Merge
Inference Endpoints
imatrix
conversational
Model card Files Community
mradermacher commited on
Commit
bd94317
·
verified ·
1 Parent(s): 8199e2a

uploaded from rich1

Browse files
Files changed (23) hide show
  1. .gitattributes +22 -0
  2. Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ1_M.gguf +3 -0
  3. Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ1_S.gguf +3 -0
  4. Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ2_M.gguf +3 -0
  5. Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ2_S.gguf +3 -0
  6. Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ2_XS.gguf +3 -0
  7. Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ2_XXS.gguf +3 -0
  8. Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ3_M.gguf +3 -0
  9. Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ3_S.gguf +3 -0
  10. Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ3_XS.gguf +3 -0
  11. Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ3_XXS.gguf +3 -0
  12. Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ4_XS.gguf +3 -0
  13. Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q2_K.gguf +3 -0
  14. Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q2_K_S.gguf +3 -0
  15. Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q3_K_L.gguf +3 -0
  16. Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q3_K_M.gguf +3 -0
  17. Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q3_K_S.gguf +3 -0
  18. Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q4_0.gguf +3 -0
  19. Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q4_K_M.gguf +3 -0
  20. Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q4_K_S.gguf +3 -0
  21. Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q5_K_M.gguf +3 -0
  22. Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q5_K_S.gguf +3 -0
  23. Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -34,3 +34,25 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
49
+ Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
50
+ Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
51
+ Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
52
+ Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
53
+ Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
54
+ Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
55
+ Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
56
+ Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
57
+ Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
58
+ Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9de249b06764d54f65896ca1b639bc026720fcd54397f76f387a185e5d26d109
3
+ size 1754447872
Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9b680db7574eff20ba1803fc3a1d6cd6cbda13d1980e4a640558d4ee45c792ba
3
+ size 1612103680
Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:41b89d57907efd4aa7f1c058f7b47f2c3a1d79b774a0d0bad4401e816cb0d628
3
+ size 2500714496
Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:316a62d0490fe3239de647cd60a650b801bbc042942cf2954923e425e727144d
3
+ size 2310922240
Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:765a95a84f4ac514bda6d4bb80dcbf0fd465529e020a96b0f3f8ae8ebe641ec8
3
+ size 2198257664
Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b65379a73c64fcf37904596610408ad65e43878637a69341fe9b4a06416ee32b
3
+ size 1991688192
Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2df380e77f45f4cc3238e8b5136f382485d9991f9170e1c726ceb44549f55753
3
+ size 3284893696
Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:31488ea79ca41596b3a3e87621f6c753dce109aa5100f74a6dd60e1238fac3fc
3
+ size 3182395392
Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ef273e13a24e944d01aabe2c9d9cf2de82f143b84709824dda91a557186323bc
3
+ size 3018817536
Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8699e38cbf756150c2db324d462b82efb720c8428fb88dcc2f0eb84d480e5200
3
+ size 2827345920
Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:550d8d35c27f7f8808db147dab9439444136758355e4c84ace6e27e611662b9a
3
+ size 3907690496
Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4bb7eba119b8d1bda9d9bac9fdd5449606ee932fa00a80f938584fc7951914f7
3
+ size 2719244288
Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q2_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:24ecbaa49fc0f7dbf1b70d3252f921f7c3923948dcd913e385b632801e60bc2d
3
+ size 2528927744
Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b316ef60c8860450ded869c10d6148e5089167cb1fb7377b2d6666478d420ed
3
+ size 3822026752
Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:106451aef9c96b8e8a9a25fa347ffcb9bd7f5e39e078967211c196b051504383
3
+ size 3518988288
Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:04e2bc59da7fed68dd52c717fe3411e741d35c7e37f2e4d06c523d7a8d662350
3
+ size 3164569600
Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ddfe4f4245645069062dfb99ae842aa283848fdec9b6c7dc51ad257458ae14f6
3
+ size 4123598848
Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b9b64aba6a60b8b458278b7e9e973010671206850df39b8aa114741b2d362aea
3
+ size 4368441344
Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c868d967d5d0551f4d98455faf04ce1e094082d6c3d46047b53dd3d6b01a3d0
3
+ size 4140376064
Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d0aba7c3f64bf51fc4e574093a41ee84d375423bdba6f52d69b64b10c9cd6463
3
+ size 5131411456
Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:808b6de694b579318bab21d745c2bf8393b0d6520f65276186b9b391443702ba
3
+ size 4997718016
Mistral-7B-Instruct_v0.2_UNA-TheBeagle-7b-v1.i1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:66c620709224d5e349f9c5cb353f5d7dfcb94fdafd67b58cf9c7e1139a7cdf96
3
+ size 5942067200