Fischerboot
/

test-1.1b-but-two

Text Generation

text-generation-inference

Model card Files Files and versions Community

test-1.1b-but-two / mergekit_config.yml

Fischerboot's picture

Upload folder using huggingface_hub

b38f73e verified 12 months ago

history blame contribute delete

1 kB

	# https://huggingface.co/TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
	slices:
	- sources:
	- model: TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
	layer_range: [0, 11]
	- sources:
	- model: TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
	layer_range: [6, 11]
	- sources:
	- model: TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
	layer_range: [6, 11]
	- sources:
	- model: TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
	layer_range: [11, 16]
	- sources:
	- model: TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
	layer_range: [11, 16]
	- sources:
	- model: TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
	layer_range: [16, 19]
	- sources:
	- model: TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
	layer_range: [16, 19]
	- sources:
	- model: TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
	layer_range: [19, 22]
	merge_method: passthrough
	dtype: bfloat16