Qwen
/

Qwen2-57B-A14B-Instruct

Text Generation

Inference Endpoints

Model card Files Files and versions Community

hzhwcmhf commited on Jun 5

Commit

ababf2e

•

1 Parent(s): fc2911e

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -25,7 +25,7 @@
   "rope_theta": 1000000.0,
   "router_aux_loss_coef": 0.001,
   "shared_expert_intermediate_size": 20480,
-  "sliding_window": 4096,
   "tie_word_embeddings": false,
   "torch_dtype": "bfloat16",
   "transformers_version": "4.40.1",

   "rope_theta": 1000000.0,
   "router_aux_loss_coef": 0.001,
   "shared_expert_intermediate_size": 20480,
+  "sliding_window": 65536,
   "tie_word_embeddings": false,
   "torch_dtype": "bfloat16",
   "transformers_version": "4.40.1",