buzzcraft commited on
Commit
844c690
·
verified ·
1 Parent(s): d1ac8d8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -13
README.md CHANGED
@@ -112,20 +112,20 @@ Refer to the Provided Files table below to see what files use which methods, and
112
  <!-- README_GGUF.md-provided-files start -->
113
  ## Provided files
114
 
115
- | Name | Quant method | Bits | Size | Max RAM required | Use case |
116
  | ---- | ---- | ---- | ---- | ---- | ----- |
117
- | NorskGPT-Llama3-8b.Q2_K.gguf | Q2_K | 2 | 2.72 GB| 5.22 GB | significant quality loss - not recommended for most purposes |
118
- | NorskGPT-Llama3-8b.Q3_K_S.gguf | Q3_K_S | 3 | 3.16 GB| 5.66 GB | very small, high quality loss |
119
- | NorskGPT-Llama3-8b.Q3_K_M.gguf| Q3_K_M | 3 | 3.52 GB| 6.02 GB | very small, high quality loss |
120
- | NorskGPT-Llama3-8b.Q3_K_L.gguf | Q3_K_L | 3 | 3.82 GB| 6.32 GB | small, substantial quality loss |
121
- | NorskGPT-Llama3-8b.Q4_0.gguf| Q4_0 | 4 | 4.11 GB| 6.61 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
122
- | NorskGPT-Llama3-8b.Q4_K_S.gguf | Q4_K_S | 4 | 4.14 GB| 6.64 GB | small, greater quality loss |
123
- | NorskGPT-Llama3-8b.Q4_K_M.gguf | Q4_K_M | 4 | 4.37 GB| 6.87 GB | medium, balanced quality - recommended |
124
- | NorskGPT-Llama3-8b.Q5_0.gguf | Q5_0 | 5 | 5.00 GB| 7.50 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
125
- | NorskGPT-Llama3-8b.Q5_K_S.gguf | Q5_K_S | 5 | 5.00 GB| 7.50 GB | large, low quality loss - recommended |
126
- | NorskGPT-Llama3-8b.Q5_K_M.gguf | Q5_K_M | 5 | 5.13 GB| 7.63 GB | large, very low quality loss - recommended |
127
- | NorskGPT-Llama3-8b.Q6_K.gguf| Q6_K | 6 | 5.94 GB| 8.44 GB | very large, extremely low quality loss |
128
- | NorskGPT-Llama3-8b.Q8_0.gguf | Q8_0 | 8 | 7.70 GB| 10.20 GB | very large, extremely low quality loss - not recommended |
129
 
130
  **Note**: the above RAM figures assume no GPU offloading. If layers are offloaded to the GPU, this will reduce RAM usage and use VRAM instead.
131
 
 
112
  <!-- README_GGUF.md-provided-files start -->
113
  ## Provided files
114
 
115
+ | Name | Quant method | Bits | Use case |
116
  | ---- | ---- | ---- | ---- | ---- | ----- |
117
+ | NorskGPT-Llama3-8b.Q2_K.gguf | Q2_K | 2 | significant quality loss - not recommended for most purposes |
118
+ | NorskGPT-Llama3-8b.Q3_K_S.gguf | Q3_K_S | 3 | very small, high quality loss |
119
+ | NorskGPT-Llama3-8b.Q3_K_M.gguf| Q3_K_M | 3 | very small, high quality loss |
120
+ | NorskGPT-Llama3-8b.Q3_K_L.gguf | Q3_K_L | 3 | small, substantial quality loss |
121
+ | NorskGPT-Llama3-8b.Q4_0.gguf| Q4_0 | 4 | 4.11 GB| legacy; small, very high quality loss - prefer using Q3_K_M |
122
+ | NorskGPT-Llama3-8b.Q4_K_S.gguf | Q4_K_S | 4 | | small, greater quality loss |
123
+ | NorskGPT-Llama3-8b.Q4_K_M.gguf | Q4_K_M | 4 | | medium, balanced quality - recommended |
124
+ | NorskGPT-Llama3-8b.Q5_0.gguf | Q5_0 | 5 | legacy; medium, balanced quality - prefer using Q4_K_M |
125
+ | NorskGPT-Llama3-8b.Q5_K_S.gguf | Q5_K_S | 5 | large, low quality loss - recommended |
126
+ | NorskGPT-Llama3-8b.Q5_K_M.gguf | Q5_K_M | 5 | large, very low quality loss - recommended |
127
+ | NorskGPT-Llama3-8b.Q6_K.gguf| Q6_K | 6 | very large, extremely low quality loss |
128
+ | NorskGPT-Llama3-8b.Q8_0.gguf | Q8_0 | 8 | very large, extremely low quality loss - not recommended |
129
 
130
  **Note**: the above RAM figures assume no GPU offloading. If layers are offloaded to the GPU, this will reduce RAM usage and use VRAM instead.
131