CarlOwOs
/

Qwen3-0.6B-Base-W4A8

8-bit precision

compressed-tensors

Model card Files Files and versions

Qwen3-0.6B-Base-W4A8 / merges.txt

CarlOwOs's picture

Add FP8 dynamically quantized Qwen3-0.6B-Base model using llm-compressor

34e054c verified 4 months ago

history contribute delete

1.67 MB

File too large to display, you can check the raw version instead.