redrix
/

nepoticide-12B-Unslop-Unleashed-Mell-RPMax-v2-GGUF

creative-writing

Inference Endpoints

Model card Files Files and versions Community

redrix commited on 13 days ago

Commit

e3043eb

•

1 Parent(s): 61f92af

Update README.md

Files changed (1) hide show

README.md +6 -1

README.md CHANGED Viewed

@@ -18,4 +18,9 @@ library_name: transformers
 Static GGUF Quants of [redrix/nepoticide-12B-Unslop-Unleashed-Mell-RPMax-v2](https://huggingface.co/redrix/nepoticide-12B-Unslop-Unleashed-Mell-RPMax-v2), created with [llama.cpp](https://github.com/ggerganov/llama.cpp).
 ## Provided Quantizations:
-*Still uploading...*

 Static GGUF Quants of [redrix/nepoticide-12B-Unslop-Unleashed-Mell-RPMax-v2](https://huggingface.co/redrix/nepoticide-12B-Unslop-Unleashed-Mell-RPMax-v2), created with [llama.cpp](https://github.com/ggerganov/llama.cpp).
 ## Provided Quantizations:
+| Type                                                                                                               | Size/GB |
+| ------------------------------------------------------------------------------------------------------------------ | ------- |
+| [Q4_0](https://huggingface.co/redrix/nepoticide-12B-Unslop-Unleashed-Mell-RPMax-v2-GGUF/blob/main/nepoticide-12B-Unslop-Unleashed-Mell-RPMax-v2-Q4_0.gguf) | 7.07GB  |
+| [Q6_K](https://huggingface.co/redrix/nepoticide-12B-Unslop-Unleashed-Mell-RPMax-v2-GGUF/blob/main/nepoticide-12B-Unslop-Unleashed-Mell-RPMax-v2-Q6_K.gguf) | 10.1GB  |
+| [Q8_0](https://huggingface.co/redrix/nepoticide-12B-Unslop-Unleashed-Mell-RPMax-v2-GGUF/blob/main/nepoticide-12B-Unslop-Unleashed-Mell-RPMax-v2-Q8_0.gguf) | 13GB    |
+| [BF16](nepoticide-12B-Unslop-Unleashed-Mell-RPMax-v2-bf16.gguf) | 24.5 GB |