| language: | |
| - en | |
| - fr | |
| - de | |
| - es | |
| - pt | |
| - it | |
| - ja | |
| - ko | |
| - ru | |
| - zh | |
| - ar | |
| - fa | |
| - id | |
| - ms | |
| - ne | |
| - pl | |
| - ro | |
| - sr | |
| - sv | |
| - tr | |
| - uk | |
| - vi | |
| - hi | |
| - bn | |
| license: apache-2.0 | |
| library_name: vllm | |
| inference: false | |
| base_model: | |
| - mistralai/Mistral-Small-3.1-24B-Base-2503 | |
| extra_gated_description: If you want to learn more about how we process your personal | |
| data, please read our <a href="https://mistral.ai/terms/">Privacy Policy</a>. | |
| tags: | |
| - mlx | |
| # mlx-community/Mistral-Small-3.1-24B-Instruct-2503-6bit | |
| This model was converted to MLX format from [`prince-canuma/Mistral-Small-3.1-24B-Instruct-2503`]() using mlx-vlm version **0.1.19**. | |
| Refer to the [original model card](https://huggingface.co/prince-canuma/Mistral-Small-3.1-24B-Instruct-2503) for more details on the model. | |
| ## Use with mlx | |
| ```bash | |
| pip install -U mlx-vlm | |
| ``` | |
| ```bash | |
| python -m mlx_vlm.generate --model mlx-community/Mistral-Small-3.1-24B-Instruct-2503-6bit --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image> | |
| ``` | |