File size: 4,429 Bytes
03703df d035a60 03703df 4076712 d035a60 03703df 1bdadd4 c597678 cfa1351 af1ead5 cfa1351 c597678 af1ead5 c597678 cfa1351 c597678 af1ead5 c597678 1bdadd4 03703df 1bdadd4 03703df cfa1351 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 |
---
license: apache-2.0
language:
- en
- ja
pipeline_tag: text-generation
library_name: transformers
base_model: pfnet/plamo-2-1b
tags:
- mlx
---
# mlx-community/plamo-2-1b
The Model [mlx-community/plamo-2-1b](https://huggingface.co/mlx-community/plamo-2-1b) was
converted to MLX format from [pfnet/plamo-2-1b](https://huggingface.co/pfnet/plamo-2-1b)
using mlx-lm version **0.22.0**.
## Use with mlx
```bash
# numba is required for the new PLaMo tokenizer
pip install mlx numba 'mlx-lm>=0.22.0'
```
```bash
python -m mlx_lm.generate \
--model mlx-community/plamo-2-1b \
--prompt '็พๅณใใใซใฌใผใฎไฝใๆนใ็ดนไปใใพใใ' \
--ignore-chat-template \
--max-tokens 1024 \
--extra-eos-token '<|plamo:bos|>' \
--temp 0.7 \
--seed 0
==========
ในใใคในใฎไฝฟใๆนใใใซใฌใผใฎไฝใๆนใพใง่ฉณใใ่งฃ่ชฌใใพใใ
## ใซใฌใผใฎไฝใๆน
**โ ๆๆใ็จๆใใ**
ๅกฉใ้ฉ้ๅ ใใใจใในใใคใทใผใช้ฆใใๅบใใใพใใ
ใฏใใณใใณใชใขใณใใผใชใฉใฎในใใคในใไฝฟใใจใ้ฃๆฌฒใใใใใพใใ
**โกในใใคในใ็ใใ**
ในใใคในใฏๅงใใซๅฐใๅ
ฅใใใ ใใงใใใฎๅพใฏๅพใ
ใซๅ ใใพใใ
**โข็ใญใใฎใฟใใๅใใ็ใใ**
็ใญใใ็ใใใใจใงใ็ใฟใๅผใๅบใใใพใใ
**โฃ่ใ็ใใ**
่ใฏ่ใในใฉใคในใใฆใในใใคในใจใใๆททใใพใใ
**โค้่ใ็ใใ**
ไบบๅใใธใฃใฌใคใขใใคใณใฒใณใชใฉใไธ็ทใซ็ใใพใใ้่ใฏ็ใใๅใซใซใใใใฆใใใพใใใใ
**โฅๆฐดใๅ ใใ**
**โฆใซใฌใผใซใผใๅ ใใ**
**โงๅบๆฅไธใใ**
## ใซใฌใผใฎๅณไปใๆนๆณ
**โ ่ใ็ใใ**
่ใฏ่ใในใฉใคในใใฆใในใใคในใจใใๆททใใพใใ
**โก้่ใ็ใใ**
้่ใฏ็ใใๅใซใซใใใใฆใใใพใใใใ
**โขๆฐดใๅ ใใ**
**โฃใซใฌใผใซใผใๅ ใใ**
## ใซใฌใผใซใฏโโใๅ
ฅใใใ
**โ ใใใใ**
ใใใใใๅ ใใใใจใงใใพใใใใงใณใฏใฎใใๅณใซใชใใพใใ
**โกใซใใซใ**
ใซใใซใใๅ ใใใใจใงใ้ฆใใจ้ขจๅณใใขใใใใพใใ
**โขใใใใ**
ใใใใใๅ ใใใใจใงใในใใคใทใผใช้ขจๅณใๅ ใใใพใใ
**โฃใใใ็ผถ**
ใใใ็ผถใๅ ใใใใจใงใ้
ธๅณใๅ ใใใๆทฑใฟใฎใใๅณใใใซใชใใพใใ
**โคใจใผใฐใซใ**
ใจใผใฐใซใใๅ ใใใใจใงใใณใฏใใขใใใใพใใ
## ใซใฌใผใฎใชในในใกใฎๅ
ทๆ
**โ ่**
็่ใ่ฑ่ใ้ถ่ใชใฉใใๅฅฝใฟใฎ่ใไฝฟใฃใฆใฟใพใใใใ
**โก้่**
ไบบๅใใธใฃใฌใคใขใใคใณใฒใณใชใฉใใๅฅฝใฟใฎ้่ใไฝฟใฃใฆใฟใพใใใใ
**โขใทใผใใผใ**
ใใใใใใณใใใใชใฉใใทใผใใผใใไฝฟใฃใฆใฟใพใใใใ
**โฃใใผใบ**
ใใผใบใๅ ใใใใจใงใใฏใชใผใใผใงใณใฏใฎใใๅณใใใซใชใใพใใ
## ใซใฌใผใฎ็พๅณใใไฝใๆน
**โ ๆๆใ็จๆใใ**
ๅกฉใ้ฉ้ๅ ใใใจใในใใคใทใผใช้ฆใใๅบใใใพใใ
ใฏใใณใใณใชใขใณใใผใชใฉใฎในใใคในใไฝฟใใจใ้ฃๆฌฒใใใใใพใใ
**โกในใใคในใ็ใใ**
ในใใคในใฏๅงใใซๅฐใๅ
ฅใใใ ใใงใใใฎๅพใฏๅพใ
ใซๅ ใใพใใ
**โข็ใญใใฎใฟใใๅใใ็ใใ**
็ใญใใ็ใใใใจใงใ็ใฟใๅผใๅบใใใพใใ
**โฃ่ใ็ใใ**
่ใฏ่ใในใฉใคในใใฆใในใใคในใจใใๆททใใพใใ
**โค้่ใ็ใใ**
ไบบๅใใธใฃใฌใคใขใใคใณใฒใณใชใฉใไธ็ทใซ็ใใพใใ้่ใฏ็ใใๅใซใซใใใใฆใใใพใใใใ
**โฅๆฐดใๅ ใใ**
**โฆใซใฌใผใซใผใๅ ใใ**
**โงๅบๆฅไธใใ**
## ใพใจใ
ในใใคในใจ้่ใฎ็ตใฟๅใใใฏใใซใฌใผใฎๅณใใใๆทฑใใใฎใซๆฌ ใใใพใใใ
ใใฒไปๅ็ดนไปใใใฌใทใใๅ่ใซใ็พๅณใใใซใฌใผใไฝใฃใฆใฟใฆใใ ใใใ
==========
Prompt: 6 tokens, 87.012 tokens-per-sec
Generation: 496 tokens, 52.861 tokens-per-sec
Peak memory: 5.317 GB
```
You can also write your code to use this model like this:
```python
from mlx_lm import load, generate
model, tokenizer = load("mlx-community/plamo-2-1b")
prompt = "็พๅณใใใซใฌใผใฎไฝใๆนใฎใฌใทใใ็ดนไปใใพใใ"
response = generate(model, tokenizer, prompt=prompt, verbose=True)
```
|