Update README.md
Browse files
README.md
CHANGED
|
@@ -42,6 +42,12 @@ This is a crude proof of concept (PoC) demonstrating the feasibility of fine-tun
|
|
| 42 |
- **Device:** Apple Mac Mini M4 (32GB RAM)
|
| 43 |
- **Framework:** Apple MLX-LM
|
| 44 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 45 |
## Notes & Limitations
|
| 46 |
|
| 47 |
- This is an experimental setup; performance and efficiency optimizations are ongoing.
|
|
|
|
| 42 |
- **Device:** Apple Mac Mini M4 (32GB RAM)
|
| 43 |
- **Framework:** Apple MLX-LM
|
| 44 |
|
| 45 |
+
## Quantisations
|
| 46 |
+
|
| 47 |
+
[4 Bit](Goekdeniz-Guelmez/Josie-v6-2b-mlx-concept-4bit)
|
| 48 |
+
[6 Bit](Goekdeniz-Guelmez/Josie-v6-2b-mlx-concept-6bit)
|
| 49 |
+
[8 Bit](Goekdeniz-Guelmez/Josie-v6-2b-mlx-concept-8bit)
|
| 50 |
+
|
| 51 |
## Notes & Limitations
|
| 52 |
|
| 53 |
- This is an experimental setup; performance and efficiency optimizations are ongoing.
|