Update README.md
Browse files
README.md
CHANGED
|
@@ -29,7 +29,10 @@ BF16 available [here](https://huggingface.co/h34v7/DXP-Zero-V1.0-24b-Small-Instr
|
|
| 29 |
"repeat_penalty": 1.2,
|
| 30 |
```
|
| 31 |
|
| 32 |
-
|
|
|
|
|
|
|
|
|
|
| 33 |
|
| 34 |
|
| 35 |
The model might lack the necessary evil for making story twisty or dark adventure but it make ammend on creating coherent story in long context form.
|
|
|
|
| 29 |
"repeat_penalty": 1.2,
|
| 30 |
```
|
| 31 |
|
| 32 |
+
IQ2_M: Usable, good for 10-16 GB RAM/VRAM
|
| 33 |
+
IQ3_XXS: Very usable, good for 12-20 GB RAM/VRAM
|
| 34 |
+
IQ3_M: Solid, good for 13-18 GB RAM/VRAM
|
| 35 |
+
IQ4_XS: It's all you need, if you have 16+ GB RAM/VRAM
|
| 36 |
|
| 37 |
|
| 38 |
The model might lack the necessary evil for making story twisty or dark adventure but it make ammend on creating coherent story in long context form.
|