|
--- |
|
base_model: deepseek-ai/Janus-Pro-1B |
|
tags: |
|
- mlx |
|
- Janus-Pro-1B |
|
- Janus-Pro MLX |
|
- deepseek |
|
- apple |
|
- mac |
|
- m4 |
|
- m4 silicon |
|
--- |
|
|
|
# Casalioy/Janus-Pro-1B-q4-Casa_MLX |
|
|
|
The Model was converted using the .safetensors model to MLX format from [deepseek-ai/Janus-Pro-1B](https://huggingface.co/deepseek-ai/Janus-Pro-1B) |
|
using mlx-lm version **0.21.1**. |
|
|
|
## Use with mlx |
|
|
|
|
|
Poritng VM capabilities to Apple Silicon pending. |
|
Find some guidance here: https://github.com/ml-explore/mlx-examples/blob/main/llms/README.md |
|
|
|
|
|
```python |
|
from mlx_lm import load, generate |
|
|
|
model, tokenizer = load("Casalioy/Janus-Pro-1B-q4-Casa_MLX") |
|
|
|
prompt = "What's the meaning of Casalioy Collective?" |
|
|
|
if tokenizer.chat_template is not None: |
|
messages = [{"role": "user", "content": prompt}] |
|
prompt = tokenizer.apply_chat_template( |
|
messages, add_generation_prompt=True |
|
) |
|
|
|
response = generate(model, tokenizer, prompt=prompt, verbose=True) |
|
``` |
|
|
|
|
|
|
|
Log on Apple M4 Mac Mini 16GB |
|
|
|
```txt |
|
The Casalioy Collective is a fictional organization or entity that appears in various media, including books, movies, TV shows, and video games.<｜begin▁of▁sentence｜> It's a fictional group of individuals or characters who are part of a larger organization or movement. The name "Casalioy" is a combination of "Casual" and "Collective," which suggests a sense of unity and collective action. |
|
|
|
The organization or group is often associated with themes of rebellion, revolution, or social change. It may be a symbol of a specific ideology, a movement, or a movement within a larger movement. The group's purpose or goals are not explicitly stated, but it may be involved in activities such as protests, activism, or advocacy for social or political causes. |
|
|
|
In some cases, the Casalioy Collective may be a fictional organization created by a specific author, filmmaker, or creator. In other cases, it may be a real organization or movement that has been inspired by or is inspired by the fictional group. |
|
|
|
If you're interested in learning more about the Casalioy Collective, you can explore the following: |
|
|
|
* Books and TV shows: Look for books or TV shows that feature the Casalioy |
|
========== |
|
Prompt: 19 tokens, 326.052 tokens-per-sec |
|
Generation: 256 tokens, 97.153 tokens-per-sec |
|
Peak memory: 1.048 GB |
|
``` |
