djuna
/

Qwen2-2B-Instruct

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Qwen2-2B-Instruct / mergekit_config.yml

djuna's picture

Upload folder using huggingface_hub

717ed68 verified 4 months ago

266 Bytes

	slices:
	- sources:
	- layer_range: [0, 14]
	model: Qwen/Qwen2-1.5B-Instruct
	- sources:
	- layer_range: [7, 21]
	model: Qwen/Qwen2-1.5B-Instruct
	- sources:
	- layer_range: [14, 28]
	model: Qwen/Qwen2-1.5B-Instruct
	merge_method: passthrough
	dtype: bfloat16