async0x42
/

Rombos-LLM-V2.5-Qwen-72b-exl2_3.75bpw

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Rombos-LLM-V2.5-Qwen-72b-exl2_3.75bpw / mergekit_config.yml

async0x42's picture

Upload 15 files

e040066 verified 2 months ago

177 Bytes

	models:
	- model: ./qwen-72b-instruct
	parameters:
	weight: 1
	merge_method: ties
	base_model: ./qwen-72b
	parameters:
	normalize: true
	int8_mask: true
	dtype: bfloat16