johnsutor
/

mixture-of-gemmas-linear

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

mixture-of-gemmas-linear / mergekit_config.yml

johnsutor's picture

Upload folder using huggingface_hub

247cd23 verified 8 months ago

171 Bytes

	models:
	- model: google/gemma-7b
	parameters:
	weight: 1.0
	- model: google/codegemma-7b
	parameters:
	weight: 0.3
	merge_method: linear
	dtype: bfloat16