Update README.md
Browse files
README.md
CHANGED
|
@@ -10,6 +10,10 @@ tags:
|
|
| 10 |
This model was converted to GGUF format from [`Rombo-Org/Rombo-LLM-V3.1-QWQ-32b`](https://huggingface.co/Rombo-Org/Rombo-LLM-V3.1-QWQ-32b) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
| 11 |
Refer to the [original model card](https://huggingface.co/Rombo-Org/Rombo-LLM-V3.1-QWQ-32b) for more details on the model.
|
| 12 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 13 |
## Use with llama.cpp
|
| 14 |
Install llama.cpp through brew (works on Mac and Linux)
|
| 15 |
|
|
|
|
| 10 |
This model was converted to GGUF format from [`Rombo-Org/Rombo-LLM-V3.1-QWQ-32b`](https://huggingface.co/Rombo-Org/Rombo-LLM-V3.1-QWQ-32b) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
| 11 |
Refer to the [original model card](https://huggingface.co/Rombo-Org/Rombo-LLM-V3.1-QWQ-32b) for more details on the model.
|
| 12 |
|
| 13 |
+
---
|
| 14 |
+
Rombo-LLM-V3.1-QWQ-32b is a Continued Finetune model (Merge only) of (Qwen/QwQ-32B) and its base model (Qwen/Qwen2.5-32B). This merge is done to decrease catastrophic forgetting during finetuning, and increase overall performance of the model. The tokenizers are taken from the QwQ-32B for thinking capabilities.
|
| 15 |
+
|
| 16 |
+
---
|
| 17 |
## Use with llama.cpp
|
| 18 |
Install llama.cpp through brew (works on Mac and Linux)
|
| 19 |
|