How to run it + link to my blog
Browse files
README.md
CHANGED
@@ -12,7 +12,18 @@ library_name: mlx
|
|
12 |
---
|
13 |
# common-pile/comma-v0.1-2t ported to MLX
|
14 |
|
15 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
16 |
|
17 |
```bash
|
18 |
uv run --python 3.12 \
|
@@ -21,4 +32,3 @@ uv run --python 3.12 \
|
|
21 |
--hf-path common-pile/comma-v0.1-2t \
|
22 |
--mlx-path ./comma-v0.1-2t-mlx
|
23 |
```
|
24 |
-
See [common-pile/comma-v0.1-2t](https://huggingface.co/common-pile/comma-v0.1-2t) for the full model card.
|
|
|
12 |
---
|
13 |
# common-pile/comma-v0.1-2t ported to MLX
|
14 |
|
15 |
+
See [common-pile/comma-v0.1-2t](https://huggingface.co/common-pile/comma-v0.1-2t) for the original model card.
|
16 |
+
|
17 |
+
Try this model out using [uv](https://github.com/astral-sh/uv) like this:
|
18 |
+
```
|
19 |
+
uv run --python 3.12 \
|
20 |
+
--with mlx-lm \
|
21 |
+
mlx_lm.generate \
|
22 |
+
--model simonw/comma-v0.1-2t-mlx \
|
23 |
+
--prompt 'Facts about pelicans:'
|
24 |
+
```
|
25 |
+
|
26 |
+
More notes [on my blog](https://simonwillison.net/2025/Jun/7/comma/). I created the MLX port using this command:
|
27 |
|
28 |
```bash
|
29 |
uv run --python 3.12 \
|
|
|
32 |
--hf-path common-pile/comma-v0.1-2t \
|
33 |
--mlx-path ./comma-v0.1-2t-mlx
|
34 |
```
|
|