sadaisystems commited on
Commit
120f103
·
verified ·
1 Parent(s): b489b6a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -0
README.md CHANGED
@@ -20,6 +20,14 @@ The model is also available as:
20
  - [GGUF](https://huggingface.co/sadaisystems/sadai-mrec-qwen2.5-3B-v0.0.1-GGUF)
21
  - INT8: WIP.
22
 
 
 
 
 
 
 
 
 
23
  # Training setup
24
 
25
  The model was fine-tuned on RTX 4090; run took 80 minutes.
 
20
  - [GGUF](https://huggingface.co/sadaisystems/sadai-mrec-qwen2.5-3B-v0.0.1-GGUF)
21
  - INT8: WIP.
22
 
23
+ Recommended inference parameters:
24
+
25
+ ```
26
+ top_p=0.8
27
+ temperature=0.7
28
+ repetition_penalty=1.1
29
+ ```
30
+
31
  # Training setup
32
 
33
  The model was fine-tuned on RTX 4090; run took 80 minutes.