hum-ma commited on
Commit
4f226a4
·
verified ·
1 Parent(s): db4bb07

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -11
README.md CHANGED
@@ -3,25 +3,28 @@ pipeline_tag: text-to-image
3
  library_name: diffusers
4
  ---
5
 
6
- Q4_0 quantized SDXL models in GGUF format, to be used with the custom ComfyUI nodes from https://github.com/city96/ComfyUI-GGUF
 
 
 
 
 
 
 
 
 
 
7
 
8
  These are made with llama-quantize from [llama.cpp b3600](https://github.com/ggerganov/llama.cpp/releases/tag/b3600) patched with https://github.com/city96/ComfyUI-GGUF/blob/main/tools/lcpp.patch
9
 
10
- A couple of models are quantized with [llama.cpp b3962](https://github.com/ggerganov/llama.cpp/releases/tag/b3962) patched with lcpp_sd3.patch instead, which may give slightly different results than the default b3600-quantized ggufs but not necessarily better.
11
 
12
- Why not Q4_K or higher quants? Having tested a selection from Q3_K_S to Q8_0 for various finetunes, it seems that Q4_0 gives consistently good results for SDXL models, usually not worse than Q5, Q6 or even Q8. If the gens from Q4_0 aren't looking good enough, then it's usually best to use the original safetensors unet and load the weights at FP8 instead of any GGUF quant.
13
-
14
- https://huggingface.co/cyberdelia/CyberRealisticXL : https://civitai.com/models/312530?modelVersionId=1198781 <br>
15
- https://huggingface.co/RunDiffusion/Juggernaut-XI-v11 : https://civitai.com/models/133005?modelVersionId=782002 <br>
16
- https://huggingface.co/SG161222/RealVisXL_V4.0 : https://civitai.com/models/139562?modelVersionId=344487 <br>
17
- https://huggingface.co/SG161222/RealVisXL_V5.0 : https://civitai.com/models/139562?modelVersionId=789646 <br>
18
- https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0 <br>
19
- https://huggingface.co/GraydientPlatformAPI/zavychroma5-xl : https://civitai.com/models/119229?modelVersionId=362861 <br>
20
- https://huggingface.co/misri/zavychromaxl_v100 : https://civitai.com/models/119229?modelVersionId=1308507 <br>
21
 
22
  Repo includes basic clip-l and clip-g, and also an improved SDXL VAE called xlVAEC_c91, found here: https://civitai.com/models/152040?modelVersionId=360299 which can be recommended as it seems to give better colors, contrast and details compared to base.
23
 
24
  If model creators or others wish to have any GGUF files added or removed, I will consider such requests when I see them.
25
 
 
26
 
27
  There are also quantized models uploaded by another user at https://huggingface.co/Old-Fisherman/SDXL_Finetune_GGUF_Files
 
3
  library_name: diffusers
4
  ---
5
 
6
+ A small selection of quantized SDXL models in GGUF format, to be used with the custom ComfyUI nodes from https://github.com/city96/ComfyUI-GGUF
7
+
8
+ | Model | Hugging Face | CivitAI |
9
+ | ----- | ------- | ------------ |
10
+ | CyberRealistic XL v4 | [hf link](https://huggingface.co/cyberdelia/CyberRealisticXL) | [civit link](https://civitai.com/models/312530?modelVersionId=1198781) |
11
+ | Juggernaut v11 | [hf link](https://huggingface.co/RunDiffusion/Juggernaut-XI-v11) | [civit link](https://civitai.com/models/133005?modelVersionId=782002) |
12
+ | RealVisXL 4.0 | [hf link](https://huggingface.co/SG161222/RealVisXL_V4.0) | [civit link](https://civitai.com/models/139562?modelVersionId=344487) |
13
+ | RealVisXL 5.0 | [hf link](https://huggingface.co/SG161222/RealVisXL_V5.0) | [civit link](https://civitai.com/models/139562?modelVersionId=789646) |
14
+ | SDXL 1.0 | [hf link](https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0) | |
15
+ | ZavyChroma 5.0 | [hf link](https://huggingface.co/GraydientPlatformAPI/zavychroma5-xl) | [civit link](https://civitai.com/models/119229?modelVersionId=362861) |
16
+ | ZavyChroma 10.0 | [hf link](https://huggingface.co/misri/zavychromaxl_v100) | [civit link](https://civitai.com/models/119229?modelVersionId=1308507) |
17
 
18
  These are made with llama-quantize from [llama.cpp b3600](https://github.com/ggerganov/llama.cpp/releases/tag/b3600) patched with https://github.com/city96/ComfyUI-GGUF/blob/main/tools/lcpp.patch
19
 
20
+ A couple of models are quantized with [llama.cpp b3962](https://github.com/ggerganov/llama.cpp/releases/tag/b3962) patched with lcpp_sd3.patch instead, which may give slightly different results than the default b3600-quantized ggufs but not necessarily better. These are marked in the filenames; most users won't need these.
21
 
22
+ It seems that Q4_0 often gives good results for SDXL models, usually coherent but not always consistent with ones from an unquantized model. Adding Q5_K_M because it sometimes gives results clearly closer to the original F16 than Q4.
 
 
 
 
 
 
 
 
23
 
24
  Repo includes basic clip-l and clip-g, and also an improved SDXL VAE called xlVAEC_c91, found here: https://civitai.com/models/152040?modelVersionId=360299 which can be recommended as it seems to give better colors, contrast and details compared to base.
25
 
26
  If model creators or others wish to have any GGUF files added or removed, I will consider such requests when I see them.
27
 
28
+ ---
29
 
30
  There are also quantized models uploaded by another user at https://huggingface.co/Old-Fisherman/SDXL_Finetune_GGUF_Files