async0x42
/

Rombos-LLM-V2.5-Qwen-32b-exl2_5.0bpw

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Rombos-LLM-V2.5-Qwen-32b-exl2_5.0bpw / mergekit_config.yml

async0x42's picture

Upload 13 files

0632793 verified 22 days ago

177 Bytes

	models:
	- model: ./qwen-32b-instruct
	parameters:
	weight: 1
	merge_method: ties
	base_model: ./qwen-32b
	parameters:
	normalize: true
	int8_mask: true
	dtype: bfloat16