habanoz
/

haber-gpt-3-40M-8k-fwb2-v1.003

Model card Files Files and versions Community

haber-gpt-3-40M-8k-fwb2-v1.003 / config.json

habanoz's picture

Upload config.json with huggingface_hub

b095d08 verified about 1 month ago

history blame contribute delete

148 Bytes

	{
	"gpt_config": {
	"seq_length": 1024,
	"vocab_size": 8192,
	"n_embed": 512,
	"n_head": 8,
	"n_layer": 13,
	"dropout": 0.0
	}
	}