Upload README.md

README.md

@@ -1,98 +1,98 @@
----
-base_model:
-- sam-paech/Darkest-muse-v1
-- TheDrummer/Tiger-Gemma-9B-v3
-library_name: transformers
-tags:
-- mergekit
-- merge
-
----
-# Darkest-Tiger-Gemma-v1-9B-GGUF
-
-This is a **creative, uncensored** merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
-
-![image/png](https://i.imgur.com/Jrk1SdF.jpeg)
-
----
-
-This model was converted to GGUF format from [`Fentible/Darkest-Tiger-Gemma-v1-9B`](https://huggingface.co/Fentible/Darkest-Tiger-Gemma-v1-9B) using llama.cpp via the Fentible's [GGUF-repo-suite](https://huggingface.co/spaces/fentible/gguf-repo-suite).
-
-**GGUF Repo Suite** is based on a refactored fork of ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space, updated for offline use with windows and support for lower IQ quants.
-
-**imatrix.dat** generated using bartowski's [calibration_datav3.txt](https://gist.github.com/bartowski1182/eb213dccb3571f863da82e99418f81e8)
-
-Refer to the [original model card](https://huggingface.co/Fentible/Darkest-Tiger-Gemma-v1-9B) for more details on the model.
-
----
-
-## Merge Details
-### Merge Method
-
-This model was merged using the [SLERP](https://en.wikipedia.org/wiki/Slerp) merge method.
-
-### Models Merged
-
-The following models were included in the merge:
-* [sam-paech/Darkest-muse-v1](https://huggingface.co/sam-paech/Darkest-muse-v1)
-* [TheDrummer/Tiger-Gemma-9B-v3](https://huggingface.co/TheDrummer/Tiger-Gemma-9B-v3)
-
-### Configuration
-
-The following YAML configuration was used to produce this model:
-
-```yaml
-base_model: TheDrummer/Tiger-Gemma-9B-v3
-merge_method: slerp
-dtype: bfloat16
-slices:
-  - sources:
-      - model: sam-paech/Darkest-muse-v1
-        layer_range: [0, 42]
-      - model: TheDrummer/Tiger-Gemma-9B-v3
-        layer_range: [0, 42]
-parameters:
-  t: 0.5
-```
-
----
-
-## Use with llama.cpp
-Install llama.cpp through brew (works on Mac and Linux)
-
-```bash
-brew install llama.cpp
-
-```
-Invoke the llama.cpp server or the CLI.
-
-### CLI:
-```bash
-llama-cli --hf-repo Fentible/gemma-3-4b-it-abliterated-IQ1_S-GGUF --hf-file gemma-3-4b-it-abliterated-IQ1_S-imat.gguf -p "The meaning to life and the universe is"
-```
-
-### Server:
-```bash
-llama-server --hf-repo Fentible/gemma-3-4b-it-abliterated-IQ1_S-GGUF --hf-file gemma-3-4b-it-abliterated-IQ1_S-imat.gguf -c 2048
-```
-
-Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
-
-Step 1: Clone llama.cpp from GitHub.
-```
-git clone https://github.com/ggerganov/llama.cpp
-```
-
-Step 2: Move into the llama.cpp folder and build it with `LLAMA_CURL=1` flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).
-```
-cd llama.cpp && LLAMA_CURL=1 make
-```
-
-Step 3: Run inference through the main binary.
-```
-./llama-cli --hf-repo Fentible/gemma-3-4b-it-abliterated-IQ1_S-GGUF --hf-file gemma-3-4b-it-abliterated-IQ1_S-imat.gguf -p "The meaning to life and the universe is"
-```
-or 
-```
-./llama-server --hf-repo Fentible/gemma-3-4b-it-abliterated-IQ1_S-GGUF --hf-file gemma-3-4b-it-abliterated-IQ1_S-imat.gguf -c 2048
+---
+base_model:
+- sam-paech/Darkest-muse-v1
+- TheDrummer/Tiger-Gemma-9B-v3
+library_name: transformers
+tags:
+- mergekit
+- merge
+
+---
+# Darkest-Tiger-Gemma-9B-v1-GGUF
+
+This is a **creative, uncensored** merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+
+![image/png](https://i.imgur.com/Jrk1SdF.jpeg)
+
+---
+
+This model was converted to GGUF format from [`Fentible/Darkest-Tiger-Gemma-9B-v1`](https://huggingface.co/Fentible/Darkest-Tiger-Gemma-9B-v1) using llama.cpp via the Fentible's [GGUF-repo-suite](https://huggingface.co/spaces/fentible/gguf-repo-suite).
+
+**GGUF Repo Suite** is based on a refactored fork of ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space, updated for offline use with windows and support for lower IQ quants.
+
+**imatrix.dat** generated using bartowski's [calibration_datav3.txt](https://gist.github.com/bartowski1182/eb213dccb3571f863da82e99418f81e8)
+
+Refer to the [original model card](https://huggingface.co/Fentible/Darkest-Tiger-Gemma-9B-v1) for more details on the model.
+
+---
+
+## Merge Details
+### Merge Method
+
+This model was merged using the [SLERP](https://en.wikipedia.org/wiki/Slerp) merge method.
+
+### Models Merged
+
+The following models were included in the merge:
+* [sam-paech/Darkest-muse-v1](https://huggingface.co/sam-paech/Darkest-muse-v1)
+* [TheDrummer/Tiger-Gemma-9B-v3](https://huggingface.co/TheDrummer/Tiger-Gemma-9B-v3)
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+base_model: TheDrummer/Tiger-Gemma-9B-v3
+merge_method: slerp
+dtype: bfloat16
+slices:
+  - sources:
+      - model: sam-paech/Darkest-muse-v1
+        layer_range: [0, 42]
+      - model: TheDrummer/Tiger-Gemma-9B-v3
+        layer_range: [0, 42]
+parameters:
+  t: 0.5
+```
+
+---
+
+## Use with llama.cpp
+Install llama.cpp through brew (works on Mac and Linux)
+
+```bash
+brew install llama.cpp
+
+```
+Invoke the llama.cpp server or the CLI.
+
+### CLI:
+```bash
+llama-cli --hf-repo Fentible/Darkest-Tiger-Gemma-9B-v1 --hf-file Darkest-Tiger-Gemma-9B-v1-IQ4_XS.gguf -p "The meaning to life and the universe is"
+```
+
+### Server:
+```bash
+llama-server --hf-repo Fentible/Darkest-Tiger-Gemma-9B-v1 --hf-file Darkest-Tiger-Gemma-9B-v1-IQ4_XS.gguf -c 2048
+```
+
+Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
+
+Step 1: Clone llama.cpp from GitHub.
+```
+git clone https://github.com/ggerganov/llama.cpp
+```
+
+Step 2: Move into the llama.cpp folder and build it with `LLAMA_CURL=1` flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).
+```
+cd llama.cpp && LLAMA_CURL=1 make
+```
+
+Step 3: Run inference through the main binary.
+```
+./llama-cli --hf-repo Fentible/Darkest-Tiger-Gemma-9B-v1 --hf-file Darkest-Tiger-Gemma-9B-v1-IQ4_XS.gguf -p "The meaning to life and the universe is"
+```
+or 
+```
+./llama-server --hf-repo Fentible/Darkest-Tiger-Gemma-9B-v1 --hf-file Darkest-Tiger-Gemma-9B-v1-IQ4_XS.gguf -c 2048
 ```