Update README.md
Browse files
README.md
CHANGED
@@ -143,4 +143,44 @@ For all settings used for this model (including specifics for its "class"), incl
|
|
143 |
|
144 |
You can see all parameters used for generation, in addition to advanced parameters and samplers to get the most out of this model here:
|
145 |
|
146 |
-
[ https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters ]
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
143 |
|
144 |
You can see all parameters used for generation, in addition to advanced parameters and samplers to get the most out of this model here:
|
145 |
|
146 |
+
[ https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters ]
|
147 |
+
|
148 |
+
---
|
149 |
+
|
150 |
+
<h2>Special Thanks:</h2>
|
151 |
+
|
152 |
+
---
|
153 |
+
|
154 |
+
Special thanks to all the following, and many more...
|
155 |
+
|
156 |
+
All the model makers, fine tuners, mergers, and tweakers:
|
157 |
+
- Provides the raw "DNA" for almost all my models.
|
158 |
+
- Sources of model(s) can be found on the repo pages, especially the "source" repos with link(s) to the model creator(s).
|
159 |
+
|
160 |
+
Huggingface [ https://huggingface.co ] :
|
161 |
+
- The place to store, merge, and tune models endlessly.
|
162 |
+
- THE reason we have an open source community.
|
163 |
+
|
164 |
+
LlamaCPP [ https://github.com/ggml-org/llama.cpp ] :
|
165 |
+
- The ability to compress and run models on GPU(s), CPU(s) and almost all devices.
|
166 |
+
- Imatrix, Quantization, and other tools to tune the quants and the models.
|
167 |
+
- Llama-Server : A cli based direct interface to run GGUF models.
|
168 |
+
- The only tool I use to quant models.
|
169 |
+
|
170 |
+
Quant-Masters: Team Mradermacher, Bartowski, and many others:
|
171 |
+
- Quant models day and night for us all to use.
|
172 |
+
- They are the lifeblood of open source access.
|
173 |
+
|
174 |
+
MergeKit [ https://github.com/arcee-ai/mergekit ] :
|
175 |
+
- The universal online/offline tool to merge models together and forge something new.
|
176 |
+
- Over 20 methods to almost instantly merge model, pull them apart and put them together again.
|
177 |
+
- The tool I have used to create over 1500 models.
|
178 |
+
|
179 |
+
Lmstudio [ https://lmstudio.ai/ ] :
|
180 |
+
- The go to tool to test and run models in GGUF format.
|
181 |
+
- The Tool I use to test/refine and evaluate new models.
|
182 |
+
- LMStudio forum on discord; endless info and community for open source.
|
183 |
+
|
184 |
+
Text Generation Webui // KolboldCPP // SillyTavern:
|
185 |
+
- Excellent tools to run GGUF models with - [ https://github.com/oobabooga/text-generation-webui ] [ https://github.com/LostRuins/koboldcpp ] .
|
186 |
+
- Sillytavern [ https://github.com/SillyTavern/SillyTavern ] can be used with LMSTudio [ https://lmstudio.ai/ ] , TextGen [ https://github.com/oobabooga/text-generation-webui ], Kolboldcpp [ https://github.com/LostRuins/koboldcpp ], Llama-Server [part of LLAMAcpp] as a off the scale front end control system and interface to work with models.
|