GGUF
iMat
imatrix
conversational
InferenceIllusionist commited on
Commit
3c181a3
·
verified ·
1 Parent(s): f3cd86e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +52 -5
README.md CHANGED
@@ -1,5 +1,52 @@
1
- ---
2
- license: other
3
- license_name: mistral-research-license
4
- license_link: LICENSE
5
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ inference: false
3
+ language:
4
+ - en
5
+ - fr
6
+ - de
7
+ - es
8
+ - it
9
+ - pt
10
+ - zh
11
+ - ja
12
+ - ru
13
+ - ko
14
+ license: other
15
+ license_link: https://mistral.ai/licenses/MRL-0.1.md
16
+ license_name: mistral-research-license
17
+ base_model_relation: quantized
18
+ quantized_by: Quant-Cartel
19
+ base_model: mistralai/Mistral-Large-Instruct-2411
20
+ tags:
21
+ - iMat
22
+ - gguf
23
+ ---
24
+ ```
25
+ e88 88e d8
26
+ d888 888b 8888 8888 ,"Y88b 888 8e d88
27
+ C8888 8888D 8888 8888 "8" 888 888 88b d88888
28
+ Y888 888P Y888 888P ,ee 888 888 888 888
29
+ "88 88" "88 88" "88 888 888 888 888
30
+ b
31
+ 8b,
32
+
33
+ e88'Y88 d8 888
34
+ d888 'Y ,"Y88b 888,8, d88 ,e e, 888
35
+ C8888 "8" 888 888 " d88888 d88 88b 888
36
+ Y888 ,d ,ee 888 888 888 888 , 888
37
+ "88,d88 "88 888 888 888 "YeeP" 888
38
+
39
+ PROUDLY PRESENTS
40
+ ```
41
+ # Mistral-Large-Instruct-2411-iMat-GGUF
42
+
43
+ Quantized from fp16.
44
+
45
+ Original model author: [mistralai](https://huggingface.co/mistralai/)
46
+
47
+ * Importance Matrix calculated using [groups_merged.txt](https://github.com/ggerganov/llama.cpp/discussions/5263#discussioncomment-8395384)
48
+ * 105 chunks
49
+ * n_ctx=512
50
+ * Calculation uses f16 precision model weights
51
+
52
+ Original model README [here](https://huggingface.co/mistralai/Mistral-Large-Instruct-2411)