Update README.md

README.md

@@ -1,31 +1,107 @@
 ---
 base_model:
-- Nohobby/L3.3-Prikol-70B-v0.1a
+- unsloth/Llama-3.3-70B-Instruct
+- pankajmathur/orca_mini_v9_3_70B
+- EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1
+- Undi95/Sushi-v1.4
 - Sao10K/70B-L3.3-Cirrus-x1
+- Nohobby/L3.3-Prikol-70B-v0.1a
 library_name: transformers
 tags:
 - mergekit
 - merge
 
 ---
-# prikol
+# Prikol
+
+> I don't even know anymore
+
+![Меня нужно изолировать от общества](https://files.catbox.moe/x9t3zo.png)
+
+### Overview
+
+A merge of some Llama 3.3 models because um uh yeah
+
+Went extra schizo on the recepie hoping for some extra fun result and... Well, I guess it's an overall improvement over the previous revision. It's a tiny bit smarter, has even more distinct swipes and nicer writing thanks to Cirrus, but for some reason it's damn sloppy. 
+
+I've published the second step of this merge as a separate model, and I'd say the results are more interesting, but not as usable as this one. https://huggingface.co/Nohobby/AbominationSnowPig
+
+Propmt format: Llama3
+
+Samplers: [This kinda works but I'm weird](https://files.catbox.moe/olsiei.json)
+
+### Quants
 
-This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+[Static](https://huggingface.co/mradermacher/L3.3-Prikol-70B-v0.2-GGUF)
 
 ## Merge Details
-### Merge Method
+### Merging Steps
 
-This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using AbominationSnowPig as a base.
+### Step1
 
-### Models Merged
+```yaml
+models:
+  - model: pankajmathur/orca_mini_v9_3_70B
+  - model: EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1
+    parameters:
+      weight: 1
+      density: 0.55
+      gamma: 0.03
+  - model: Undi95/Sushi-v1.4
+    parameters:
+      weight: 0.069
+      gamma: 0.001
+      density: 0.911
+merge_method: breadcrumbs
+base_model: pankajmathur/orca_mini_v9_3_70B
+parameters:
+  int8_mask: true
+  rescale: true
+  normalize: true
+dtype: bfloat16
+tokenizer_source: base
+```
 
-The following models were included in the merge:
-* [Nohobby/L3.3-Prikol-70B-v0.1a](https://huggingface.co/Nohobby/L3.3-Prikol-70B-v0.1a)
-* [Sao10K/70B-L3.3-Cirrus-x1](https://huggingface.co/Sao10K/70B-L3.3-Cirrus-x1)
+### Step2 [(AbominationSnowPig)](https://huggingface.co/Nohobby/AbominationSnowPig)
 
-### Configuration
+```yaml
+dtype: bfloat16
+tokenizer_source: base
+merge_method: nuslerp
+parameters:
+  nuslerp_row_wise: true
+models:
+  - model: unsloth/Llama-3.3-70B-Instruct
+    parameters:
+      weight:
+        - filter: v_proj
+          value: [0, 0, 1, 1, 1, 1, 1, 1, 1, 0, 0]
+        - filter: o_proj
+          value: [1, 0, 1, 0, 0, 0, 0, 0, 1, 1, 1]
+        - filter: up_proj
+          value: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
+        - filter: gate_proj
+          value: [0, 0, 1, 1, 1, 1, 1, 1, 1, 0, 0]
+        - filter: down_proj
+          value: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
+        - value: 0
+  - model: Step1
+    parameters:
+      weight:
+        - filter: v_proj
+          value: [1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 1]
+        - filter: o_proj
+          value: [0, 1, 0, 1, 1, 1, 1, 1, 0, 0, 0]
+        - filter: up_proj
+          value: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
+        - filter: gate_proj
+          value: [1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 1]
+        - filter: down_proj
+          value: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
+        - value: 1
+```
 
-The following YAML configuration was used to produce this model:
+### Step3
 
 ```yaml
 base_model: AbominationSnowPig
@@ -34,5 +110,4 @@ dtype: bfloat16
 models:
   - model: Sao10K/70B-L3.3-Cirrus-x1
   - model: Nohobby/L3.3-Prikol-70B-v0.1a
-
-```
+```