Upload folder using huggingface_hub

README.md

@@ -1,7 +1,7 @@
 ---
 base_model:
-- gradientai/Llama-3-8B-Instruct-262k
 - Nitral-AI/Echidna-7b-128k
+- gradientai/Llama-3-8B-Instruct-262k
 library_name: transformers
 tags:
 - mergekit
@@ -15,11 +15,12 @@ This is a merge of pre-trained language models created using [mergekit](https://
 ## Merge Details
 ### Merge Method
 
-This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [Nitral-AI/Echidna-7b-128k](https://huggingface.co/Nitral-AI/Echidna-7b-128k) as a base.
+This model was merged using the [linear](https://arxiv.org/abs/2203.05482) merge method.
 
 ### Models Merged
 
 The following models were included in the merge:
+* [Nitral-AI/Echidna-7b-128k](https://huggingface.co/Nitral-AI/Echidna-7b-128k)
 * [gradientai/Llama-3-8B-Instruct-262k](https://huggingface.co/gradientai/Llama-3-8B-Instruct-262k)
 
 ### Configuration
@@ -29,16 +30,11 @@ The following YAML configuration was used to produce this model:
 ```yaml
 models:
   - model: Nitral-AI/Echidna-7b-128k
-    #no parameters necessary for base model
+    parameters:
+      weight: 1.0
   - model: gradientai/Llama-3-8B-Instruct-262k
     parameters:
-      density: 0.5
-      weight: 0.5
-
-merge_method: dare_ties
-base_model: Nitral-AI/Echidna-7b-128k
-parameters:
-  normalize: false
-  int8_mask: true
+      weight: 0.1
+merge_method: linear
 dtype: float16
 ```

mergekit_config.yml

@@ -1,14 +1,9 @@
 models:
   - model: Nitral-AI/Echidna-7b-128k
-    #no parameters necessary for base model
+    parameters:
+      weight: 1.0
   - model: gradientai/Llama-3-8B-Instruct-262k
     parameters:
-      density: 0.5
-      weight: 0.5
-
-merge_method: dare_ties
-base_model: Nitral-AI/Echidna-7b-128k
-parameters:
-  normalize: false
-  int8_mask: true
+      weight: 0.1
+merge_method: linear
 dtype: float16

model-00001-of-00002.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d34c2d764c9c19ed6bda63c4152b2aa1cb22de28802ccb388cbe35fc41970d64
+oid sha256:ebfd77390cc40bb438f7d3e409c6d4418af926448ed183e4f08f7064f8991e03
 size 9886332840

model-00002-of-00002.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c1bef63c1bc0c472204db362995510403980f10f7d133757370b2c0a9eb3a41b
+oid sha256:763a81a352a8e1e661ee6074285a6c81a41504ff62f6091a33f1dab3d170ef2b
 size 4597164888