PrunaAI
/

trl-internal-testing-dummy-GPT2-correct-vocab-bnb-8bit-smashed

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

trl-internal-testing-dummy-GPT2-correct-vocab-bnb-8bit-smashed / generation_config.json

sharpenb's picture

8a8c41699988379f9e3c97080740be5ed1d4d42dcaabc4b43ecc1ffe79074d60

dc1d0be verified 11 months ago

135 Bytes

	{
	"_from_model_config": true,
	"bos_token_id": 0,
	"eos_token_id": 0,
	"pad_token_id": 1023,
	"transformers_version": "4.37.1"
	}