rhymes-ai
/

Aria-Base-8K

Image-Text-to-Text

Inference Endpoints

Model card Files Files and versions Community

teowu commited on 25 days ago

Commit

f595320

•

1 Parent(s): c0dddce

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -25,7 +25,7 @@
     "num_experts_per_tok": 6,
     "num_hidden_layers": 28,
     "num_key_value_heads": 20,
-    "rope_theta": 5000000,
     "vocab_size": 100352
   },
   "torch_dtype": "bfloat16",

     "num_experts_per_tok": 6,
     "num_hidden_layers": 28,
     "num_key_value_heads": 20,
+    "rope_theta": 100000,
     "vocab_size": 100352
   },
   "torch_dtype": "bfloat16",