mergekit-community
/

qwen1m

Text Generation

text-generation-inference

Model card Files Files and versions Community

qwen1m / mergekit_config.yml

chargoddard's picture

Upload folder using huggingface_hub

0228d81 verified 6 months ago

history blame contribute delete

255 Bytes

	base_model: Qwen/Qwen2.5-14B-Instruct-1M
	merge_method: passthrough
	slices:
	- sources:
	- model: Qwen/Qwen2.5-14B-Instruct-1M
	layer_range: [0, 48]
	- sources:
	- model: Qwen/Qwen2.5-14B-Instruct-1M
	layer_range: [0, 48]
	dtype: bfloat16