winglian
/

phi-1_5-2x

Text Generation

mixformer-sequential

Model card Files Files and versions Community

winglian commited on Sep 12, 2023

Commit

f293f7a

·

1 Parent(s): adb0ddd

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -23,7 +23,7 @@
   "n_embd": 2048,
   "n_head": 32,
   "n_inner": null,
-  "n_layer": 24,
   "n_positions": 2048,
   "phyagi_version": "0.0.4.dev",
   "resid_pdrop": 0.0,

   "n_embd": 2048,
   "n_head": 32,
   "n_inner": null,
+  "n_layer": 48,
   "n_positions": 2048,
   "phyagi_version": "0.0.4.dev",
   "resid_pdrop": 0.0,