Update README.md
Browse files
README.md
CHANGED
|
@@ -1,4 +1,4 @@
|
|
| 1 |
-
Custom GGUF quants of Hermes-3-Llama-3.1-8B, where the Output Tensors are quantized to Q8_0 while the Embeddings are kept at F32. Enjoy! 🧠🔥🚀
|
| 2 |
|
| 3 |
Update: This repo now contains OF32.EF32 GGUF IQuants for even more accuracy. Enjoy! 😋
|
| 4 |
|
|
|
|
| 1 |
+
Custom GGUF quants of [NousResearch/Hermes-3-Llama-3.1-8B](https://huggingface.co/NousResearch/Hermes-3-Llama-3.1-8B), where the Output Tensors are quantized to Q8_0 while the Embeddings are kept at F32. Enjoy! 🧠🔥🚀
|
| 2 |
|
| 3 |
Update: This repo now contains OF32.EF32 GGUF IQuants for even more accuracy. Enjoy! 😋
|
| 4 |
|