farpluto
/

InternVL2-4B

Image-Text-to-Text

feature-extraction

Model card Files Files and versions Community

farpluto commited on Jul 23

Commit

a08c032

•

1 Parent(s): 740bbaf

Update configuration_intern_vit.py

Files changed (1) hide show

configuration_intern_vit.py +1 -1

configuration_intern_vit.py CHANGED Viewed

@@ -71,7 +71,7 @@ class InternVisionConfig(PretrainedConfig):
             intermediate_size=12800,
             qk_normalization=True,
             num_hidden_layers=48,
-            use_flash_attn=True,
             hidden_act='gelu',
             norm_type='rms_norm',
             layer_norm_eps=1e-6,

             intermediate_size=12800,
             qk_normalization=True,
             num_hidden_layers=48,
+            use_flash_attn=False,
             hidden_act='gelu',
             norm_type='rms_norm',
             layer_norm_eps=1e-6,