ayjays132
/

PhillnetLarge

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

ayjays132 commited on Jan 11

Commit

d14f63d

•

1 Parent(s): ff17e6a

Update config.json

Files changed (1) hide show

config.json +1 -0

config.json CHANGED Viewed

@@ -74,4 +74,5 @@
   "waiting_served_ratio": 1.2,
   "max_batch_prefill_tokens": 2048,
   "max_waiting_tokens": 20
 }

   "waiting_served_ratio": 1.2,
   "max_batch_prefill_tokens": 2048,
   "max_waiting_tokens": 20
+  "sharded": false,
 }