rombodawg
/

Open_Gpt4_8x7B_v0.2

Text Generation

Mixture of Experts

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

rombodawg commited on Jan 11

Commit

9ceca5c

•

1 Parent(s): c75ea3b

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -35,11 +35,11 @@ Merger config:
 models:
   - model: Mixtral-8x7B-Instruct-v0.1
     parameters:
-      density: 1
-      weight: 1
   - model: bagel-8x7b-v0.2
     parameters:
-      density: .7
       weight: 1

 models:
   - model: Mixtral-8x7B-Instruct-v0.1
     parameters:
+      density: .5
+      weight: .7
   - model: bagel-8x7b-v0.2
     parameters:
+      density: .5
       weight: 1