mlx-community
/

Qwen3-14B-4bit-AWQ

Text Generation

Model card Files Files and versions

sudo-0x2a commited on Jun 22

Commit

510d70b

·

verified ·

1 Parent(s): 1377f7f

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -14,6 +14,8 @@ This model [mlx-community/Qwen3-14B-4bit-AWQ](https://huggingface.co/mlx-communi
 converted to MLX format from [Qwen/Qwen3-14B](https://huggingface.co/Qwen/Qwen3-14B)
 using mlx-lm version **0.25.2**.
 ## Use with mlx
 ```bash

 converted to MLX format from [Qwen/Qwen3-14B](https://huggingface.co/Qwen/Qwen3-14B)
 using mlx-lm version **0.25.2**.
+AWQ Parameters: --bits 4 --group-size 64 --embed-bits 4 --embed-group-size 32 --num-samples 256 --sequence-length 1024 --n-grid 50
 ## Use with mlx
 ```bash