mlx-community
/

Huihui-gemma-3-270m-it-abliterated-4bit

Text Generation

Generated from Trainer

text-generation-inference

4-bit precision

Model card Files Files and versions

Felladrin commited on 25 days ago

Commit

10918f0

·

verified ·

1 Parent(s): e52d416

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -16,9 +16,9 @@ pipeline_tag: text-generation
 library_name: transformers
 ---
-# Felladrin/Huihui-gemma-3-270m-it-abliterated-mlx-4Bit
-The Model [Felladrin/Huihui-gemma-3-270m-it-abliterated-mlx-4Bit](https://huggingface.co/Felladrin/Huihui-gemma-3-270m-it-abliterated-mlx-4Bit) was converted to MLX format from [huihui-ai/Huihui-gemma-3-270m-it-abliterated](https://huggingface.co/huihui-ai/Huihui-gemma-3-270m-it-abliterated) using mlx-lm version **0.26.4**.
 ## Use with mlx
@@ -29,7 +29,7 @@ pip install mlx-lm
 ```python
 from mlx_lm import load, generate
-model, tokenizer = load("Felladrin/Huihui-gemma-3-270m-it-abliterated-mlx-4Bit")
 prompt="hello"

 library_name: transformers
 ---
+# mlx-community/Huihui-gemma-3-270m-it-abliterated-4bit
+The Model [mlx-community/Huihui-gemma-3-270m-it-abliterated-4bit](https://huggingface.co/mlx-community/Huihui-gemma-3-270m-it-abliterated-4bit) was converted to MLX format from [huihui-ai/Huihui-gemma-3-270m-it-abliterated](https://huggingface.co/huihui-ai/Huihui-gemma-3-270m-it-abliterated) using mlx-lm version **0.26.4**.
 ## Use with mlx
 ```python
 from mlx_lm import load, generate
+model, tokenizer = load("mlx-community/Huihui-gemma-3-270m-it-abliterated-4bit")
 prompt="hello"