Update README.md
Browse files
README.md
CHANGED
@@ -46,7 +46,7 @@ BitCPM4 are ternary quantized models derived from the MiniCPM series models thro
|
|
46 |
### Inference with [llama.cpp](https://github.com/ggml-org/llama.cpp)
|
47 |
|
48 |
```bash
|
49 |
-
./llama-cli -c 1024 -m BitCPM4-0.5B-
|
50 |
```
|
51 |
|
52 |
## Evaluation Results
|
|
|
46 |
### Inference with [llama.cpp](https://github.com/ggml-org/llama.cpp)
|
47 |
|
48 |
```bash
|
49 |
+
./llama-cli -c 1024 -m BitCPM4-0.5B-q4_0.gguf -n 1024 --top-p 0.7 --temp 0.7 --prompt "请写一篇关于人工智能的文章,详细介绍人工智能的未来发展和隐患。"
|
50 |
```
|
51 |
|
52 |
## Evaluation Results
|