Create README.md

README.md

@@ -0,0 +1,60 @@
+---
+base_model:
+- Test157t/Yarncules-7b-128k
+- Test157t/Prima-LelantaclesV3-7b
+library_name: transformers
+tags:
+- mistral
+- quantized
+- text-generation-inference
+- merge
+- mergekit
+pipeline_tag: text-generation
+inference: false
+---
+**GGUF quantizations for [Pasta-Lake-7b](https://huggingface.co/Test157t/Pasta-Lake-7b).**
+
+*If you want any specific quantization to be added, feel free to ask.*
+
+All credits belong to the [creator](https://huggingface.co/Test157t/).
+
+SillyTavern preset files [here](https://huggingface.co/Test157t/Pasta-Lake-7b/tree/main/ST%20PRESETS).
+
+`Base⇢ GGUF(F16)⇢ GGUF(Quants)`
+
+Using [llama.cpp](https://github.com/ggerganov/llama.cpp/)-[b2217](https://github.com/ggerganov/llama.cpp/releases/tag/b2217).
+
+# Original model information:
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/Q-4HMjTgR6cpLnuW6Ghk3.png)
+
+### Models Merged
+
+The following models were included in the merge:
+* [Test157t/Pasta-PrimaMaid-7b](https://huggingface.co/Test157t/Pasta-PrimaMaid-7b)
+* [macadeliccc/WestLake-7B-v2-laser-truthy-dpo](https://huggingface.co/macadeliccc/WestLake-7B-v2-laser-truthy-dpo)
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+slices:
+  - sources:
+      - model: Test157t/Pasta-PrimaMaid-7b
+        layer_range: [0, 32]
+      - model: macadeliccc/WestLake-7B-v2-laser-truthy-dpo
+        layer_range: [0, 32]
+merge_method: slerp
+base_model: Test157t/Pasta-PrimaMaid-7b
+parameters:
+  t:
+    - filter: self_attn
+      value: [0, 0.5, 0.3, 0.7, 1]
+    - filter: mlp
+      value: [1, 0.5, 0.7, 0.3, 0]
+    - value: 0.5
+dtype: float16
+```
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/dfYLzaMs5KU4BtbQQKzat.png)