Canum-med-Qwen3-Reasoning-GGUF

Canum-med-Qwen3-Reasoning is an experimental medical reasoning and advisory model fine-tuned on Qwen/Qwen3-1.7B using the MTEB/raw_medrxiv dataset. It is designed to support clinical reasoning, biomedical understanding, and structured advisory outputs, making it a useful tool for researchers, educators, and medical professionals in experimental workflows.

Model Files

File Name	Quant Type	File Size
Canum-med-Qwen3-Reasoning.BF16.gguf	BF16	3.45 GB
Canum-med-Qwen3-Reasoning.F16.gguf	F16	3.45 GB
Canum-med-Qwen3-Reasoning.F32.gguf	F32	6.89 GB
Canum-med-Qwen3-Reasoning.Q2_K.gguf	Q2_K	778 MB
Canum-med-Qwen3-Reasoning.Q3_K_L.gguf	Q3_K_L	1 GB
Canum-med-Qwen3-Reasoning.Q3_K_M.gguf	Q3_K_M	940 MB
Canum-med-Qwen3-Reasoning.Q3_K_S.gguf	Q3_K_S	867 MB
Canum-med-Qwen3-Reasoning.Q4_0.gguf	Q4_0	1.05 GB
Canum-med-Qwen3-Reasoning.Q4_1.gguf	Q4_1	1.14 GB
Canum-med-Qwen3-Reasoning.Q4_K.gguf	Q4_K	1.11 GB
Canum-med-Qwen3-Reasoning.Q4_K_M.gguf	Q4_K_M	1.11 GB
Canum-med-Qwen3-Reasoning.Q4_K_S.gguf	Q4_K_S	1.06 GB
Canum-med-Qwen3-Reasoning.Q5_0.gguf	Q5_0	1.23 GB
Canum-med-Qwen3-Reasoning.Q5_1.gguf	Q5_1	1.32 GB
Canum-med-Qwen3-Reasoning.Q5_K.gguf	Q5_K	1.26 GB
Canum-med-Qwen3-Reasoning.Q5_K_M.gguf	Q5_K_M	1.26 GB
Canum-med-Qwen3-Reasoning.Q5_K_S.gguf	Q5_K_S	1.23 GB
Canum-med-Qwen3-Reasoning.Q6_K.gguf	Q6_K	1.42 GB
Canum-med-Qwen3-Reasoning.Q8_0.gguf	Q8_0	1.83 GB

Quants Usage

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):