stupidity-ai
/

Franqwen-4.5B-Instruct

Text Generation

text-generation-inference

Model card Files Files and versions

Franqwen-4.5B-Instruct / mergekit_config.yml

Austin Stockbridge

Upload folder using huggingface_hub

b3e47e5 verified 6 months ago

history blame contribute delete

368 Bytes

	slices:
	- sources:
	- model: Qwen/Qwen2.5-3B-Instruct
	layer_range: [0, 26]
	- sources:
	- model: Qwen/Qwen2.5-1.5B-Instruct
	layer_range: [0, 18]
	- sources:
	- model: Qwen/Qwen2.5-3B-Instruct
	layer_range: [26, 36]
	- sources:
	- model: Qwen/Qwen2.5-1.5B-Instruct
	layer_range: [18, 28]
	merge_method: passthrough
	dtype: bfloat16