Update README.md
Browse files
README.md
CHANGED
|
@@ -31,6 +31,7 @@ This training regimen, coupled with advanced techniques like manual learning rat
|
|
| 31 |
# How to install
|
| 32 |
|
| 33 |
On Huggingface, press the `Use this model` dropdown menu, and choose `Ollama`, then in the drop down menu, choose your quantization, following this GPU VRAM chart:
|
|
|
|
| 34 |
*All of these values assume a context window size of 8192 or less*
|
| 35 |
```
|
| 36 |
F16 = 20+ GB
|
|
|
|
| 31 |
# How to install
|
| 32 |
|
| 33 |
On Huggingface, press the `Use this model` dropdown menu, and choose `Ollama`, then in the drop down menu, choose your quantization, following this GPU VRAM chart:
|
| 34 |
+
|
| 35 |
*All of these values assume a context window size of 8192 or less*
|
| 36 |
```
|
| 37 |
F16 = 20+ GB
|