Change max_position_embeddings to original value
#18
by
AshtonIsNotHere
- opened
max_position_embeddings in this config was set to 16384, which seems to be an error (this is exactly the same as hidden_size) and should actually be 131072. In both the original model config and the AWQ-quantized config, the value for max_position_embeddings is 131072.