language: | |
- hi | |
license: llama2 | |
tags: | |
- mlx | |
# OpenHathi-7B-Hi-v0.1-Base-4bit-mlx | |
This model was converted to MLX format from [`sarvamai/OpenHathi-7B-Hi-v0.1-Base`](). | |
Refer to the [original model card](https://huggingface.co/sarvamai/OpenHathi-7B-Hi-v0.1-Base) for more details on the model. | |
## Use with mlx | |
```bash | |
pip install mlx | |
git clone https://github.com/ml-explore/mlx-examples.git | |
cd mlx-examples/llms/hf_llm | |
python generate.py --model mlx-community/OpenHathi-7B-Hi-v0.1-Base-4bit-mlx --prompt "My name is" | |
``` | |