Update README.md
Browse files
README.md
CHANGED
@@ -20,6 +20,14 @@ The model is also available as:
|
|
20 |
- [GGUF](https://huggingface.co/sadaisystems/sadai-mrec-qwen2.5-3B-v0.0.1-GGUF)
|
21 |
- INT8: WIP.
|
22 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
23 |
# Training setup
|
24 |
|
25 |
The model was fine-tuned on RTX 4090; run took 80 minutes.
|
|
|
20 |
- [GGUF](https://huggingface.co/sadaisystems/sadai-mrec-qwen2.5-3B-v0.0.1-GGUF)
|
21 |
- INT8: WIP.
|
22 |
|
23 |
+
Recommended inference parameters:
|
24 |
+
|
25 |
+
```
|
26 |
+
top_p=0.8
|
27 |
+
temperature=0.7
|
28 |
+
repetition_penalty=1.1
|
29 |
+
```
|
30 |
+
|
31 |
# Training setup
|
32 |
|
33 |
The model was fine-tuned on RTX 4090; run took 80 minutes.
|