Update README.md
Browse files
README.md
CHANGED
@@ -47,4 +47,6 @@ In this model, I grafted Mistral Small 3.1's vision encoder on to Magistral Smal
|
|
47 |
|
48 |
The model was tested with vLLM and should work with any toolkit supporting Mistral Small 3.1. The Transformers implementation of Mistral 3 does not work well.
|
49 |
|
50 |
-
|
|
|
|
|
|
47 |
|
48 |
The model was tested with vLLM and should work with any toolkit supporting Mistral Small 3.1. The Transformers implementation of Mistral 3 does not work well.
|
49 |
|
50 |
+
Make sure to use the system prompt provided in the `SYSTEM_PROMPT.txt` file (from Mistral's docs) and the sampling params `temp=0.7, top_p=0.95`.
|
51 |
+
|
52 |
+
There still may be configuration errors in this model which might reduce performance. Let me know if you encounter any weird behavior!
|