Hugging Face's logo

JunxiongWang
/
BiGS_128

Fill-Mask
Transformers
PyTorch
JAX
English
BiGS
Model card Files Community
1
JunxiongWang commited on
Commit
6adc39a
·
1 Parent(s): 13cc84f

Update

Browse files
Files changed (1) hide show
  1. config.json +1 -1
config.json CHANGED
@@ -15,7 +15,7 @@
15
  "num_hidden_layers": 23,
16
  "num_ssm": 64,
17
  "pad_token_id": 0,
18
- "pooler_type": "mean",
19
  "position_embedding_type": "absolute",
20
  "pre_norm": true,
21
  "transformers_version": "4.26.0.dev0",
 
15
  "num_hidden_layers": 23,
16
  "num_ssm": 64,
17
  "pad_token_id": 0,
18
+ "pooler_type": "non_padding_mean",
19
  "position_embedding_type": "absolute",
20
  "pre_norm": true,
21
  "transformers_version": "4.26.0.dev0",