Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+Mistral-Nemo-12B-ArliAI-RPMax-v1.2.fq8.gguf filter=lfs diff=lfs merge=lfs -text
+Mistral-Nemo-12B-ArliAI-RPMax-v1.2.silly.gguf filter=lfs diff=lfs merge=lfs -text

Mistral-Nemo-12B-ArliAI-RPMax-v1.2.fq8.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:308b4b0c020afaa50d33a370cc4442538fc1b89b587538434264ea4ab04eda1b
+size 14280663488

Mistral-Nemo-12B-ArliAI-RPMax-v1.2.silly.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fc14d5790fd71f04f76c71338b8dd04e0ce41643af4c4654a0f7cb3d64fa684c
+size 14280663488

README.md

@@ -0,0 +1,40 @@
+
+---
+license: mit
+language:
+- en
+pipeline_tag: text-generation
+---
+
+ZeroWw 'SILLY' version.
+The original model has been quantized (fq8 version)
+and a percentage of it's tensors have
+been modified adding some noise.
+
+Full colab: https://colab.research.google.com/drive/1a7seagBzu5l3k3FL4SFk0YJocl7nsDJw?usp=sharing
+
+Fast colab: https://colab.research.google.com/drive/1SDD7ox21di_82Y9v68AUoy0PhkxwBVvN?usp=sharing
+
+Original reddit post: https://www.reddit.com/r/LocalLLaMA/comments/1ec0s8p/i_made_a_silly_test/
+
+I created a program to randomize the weights of a model. The program has 2 parameters: the percentage of weights to modify and the percentage of the original value to randmly apply to each weight.
+
+At the end I check the resulting GGUF file for binary differences.
+In this example I set to modify 100% of the weights of Mistral 7b Instruct v0.3 by a maximum of 15% deviation.
+
+Since the deviation is calculated on the F32 weights, when quantized to Q8\_0 this changes.
+So, in the end I got a file that compared to the original has:
+
+Bytes Difference percentage: 73.04%
+
+Average value divergence: 2.98%
+
+The cool thing is that chatting with the model I see no apparent difference and the model still works nicely as the original.
+
+Since I am running everything on CPU, I could not run perplexity scores or anything computing intensive.
+
+As a small test, I asked the model a few questions (like the history of the roman empire) and then fact check its answer using a big model. No errors were detected.
+
+Update: all procedure tested and created on COLAB.
+
+Created on: Wed Oct 23, 09:31:20