Upload folder using huggingface_hub

NoobAI-XL-Vpred-v1.0.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ea349eeae87ca8d25ba902c93810f7ca83e5c82f920edf12f273af004ae02819
+size 7105350110

README.md

@@ -0,0 +1,287 @@
+---
+license: other
+license_name: fair-ai-public-license-1.0-sd
+license_link: https://freedevproject.org/faipl-1.0-sd/
+language:
+- en
+base_model:
+- Laxhar/noobai-XL-Vpred-0.75
+pipeline_tag: text-to-image
+tags:
+- safetensors
+- diffusers
+- stable-diffusion
+- stable-diffusion-xl
+- art
+- not-for-all-audiences
+library_name: diffusers
+---
+
+<h1 align="center"><strong style="font-size: 48px;">NoobAI XL V-Pred 1.0</strong></h1>
+
+# Model Introduction
+
+This image generation model, based on Laxhar/noobai-XL_v1.0, leverages full Danbooru and e621 datasets with native tags and natural language captioning.
+
+Implemented as a v-prediction model (distinct from eps-prediction), it requires specific parameter configurations - detailed in following sections.
+
+Special thanks to my teammate euge for the coding work, and we're grateful for the technical support from many helpful community members.
+
+# ⚠️ IMPORTANT NOTICE ⚠️
+
+## **THIS MODEL WORKS DIFFERENT FROM EPS MODELS!**
+
+## **PLEASE READ THE GUIDE CAREFULLY!**
+
+## Model Details
+
+- **Developed by**: [Laxhar Lab](https://huggingface.co/Laxhar)
+- **Model Type**: Diffusion-based text-to-image generative model
+- **Fine-tuned from**: Laxhar/noobai-XL_v1.0
+- **Sponsored by from**: [Lanyun Cloud](https://cloud.lanyun.net)
+
+---
+
+# How to Use the Model.
+
+## Method I: [reForge](https://github.com/Panchovix/stable-diffusion-webui-reForge/tree/dev_upstream)
+
+1. (If you haven't installed reForge) Install reForge by following the instructions in the repository;
+
+2. Launch WebUI and use the model as usual!
+
+## Method II: [ComfyUI](https://github.com/comfyanonymous/ComfyUI)
+
+SAMLPLE with NODES 
+
+[comfy_ui_workflow_sample](/Laxhar/noobai-XL-Vpred-0.5/blob/main/comfy_ui_workflow_sample.png)
+
+
+## Method III: [WebUI](https://github.com/AUTOMATIC1111/stable-diffusion-webui)
+
+Note that dev branch is not stable and **may contain bugs**.
+
+1. (If you haven't installed WebUI) Install WebUI by following the instructions in the repository. For simp
+2. Switch to `dev` branch:
+
+```bash
+git switch dev
+```
+
+3. Pull latest updates:
+
+```bash
+git pull
+```
+
+4. Launch WebUI and use the model as usual!
+
+## Method IV: [Diffusers](https://huggingface.co/docs/diffusers/en/index)
+
+```python
+import torch
+from diffusers import StableDiffusionXLPipeline
+from diffusers import EulerDiscreteScheduler
+
+ckpt_path = "/path/to/model.safetensors"
+pipe = StableDiffusionXLPipeline.from_single_file(
+    ckpt_path,
+    use_safetensors=True,
+    torch_dtype=torch.float16,
+)
+scheduler_args = {"prediction_type": "v_prediction", "rescale_betas_zero_snr": True}
+pipe.scheduler = EulerDiscreteScheduler.from_config(pipe.scheduler.config, **scheduler_args)
+pipe.enable_xformers_memory_efficient_attention()
+pipe = pipe.to("cuda")
+
+prompt = """masterpiece, best quality,artist:john_kafka,artist:nixeu,artist:quasarcake, chromatic aberration, film grain, horror \(theme\), limited palette, x-shaped pupils, high contrast, color contrast, cold colors, arlecchino \(genshin impact\), black theme,  gritty, graphite \(medium\)"""
+negative_prompt = "nsfw, worst quality, old, early, low quality, lowres, signature, username, logo, bad hands, mutated hands, mammal, anthro, furry, ambiguous form, feral, semi-anthro"
+
+image = pipe(
+    prompt=prompt,
+    negative_prompt=negative_prompt,
+    width=832,
+    height=1216,
+    num_inference_steps=28,
+    guidance_scale=5,
+    generator=torch.Generator().manual_seed(42),
+).images[0]
+
+image.save("output.png")
+```
+
+
+**Note**: Please make sure Git is installed and environment is properly configured on your machine.
+
+---
+
+# Recommended Settings
+
+## Parameters
+
+- CFG: 4 ~ 5
+- Steps: 28 ~ 35
+- Sampling Method: **Euler** (⚠️ Other samplers will not work properly)
+- Resolution: Total area around 1024x1024. Best to choose from: 768x1344, **832x1216**, 896x1152, 1024x1024, 1152x896, 1216x832, 1344x768
+
+## Prompts
+
+- Prompt Prefix:
+
+```
+masterpiece, best quality, newest, absurdres, highres, safe,
+```
+
+- Negative Prompt:
+
+```
+nsfw, worst quality, old, early, low quality, lowres, signature, username, logo, bad hands, mutated hands, mammal, anthro, furry, ambiguous form, feral, semi-anthro
+```
+
+# Usage Guidelines
+
+## Caption
+
+```
+<1girl/1boy/1other/...>, <character>, <series>, <artists>, <special tags>, <general tags>, <other tags>
+```
+
+## Quality Tags
+
+For quality tags, we evaluated image popularity through the following process:
+
+- Data normalization based on various sources and ratings.
+- Application of time-based decay coefficients according to date recency.
+- Ranking of images within the entire dataset based on this processing.
+
+Our ultimate goal is to ensure that quality tags effectively track user preferences in recent years.
+
+| Percentile Range | Quality Tags   |
+| :--------------- | :------------- |
+| > 95th           | masterpiece    |
+| > 85th, <= 95th  | best quality   |
+| > 60th, <= 85th  | good quality   |
+| > 30th, <= 60th  | normal quality |
+| <= 30th          | worst quality  |
+
+## Aesthetic Tags
+
+| Tag             | Description                                                                                                                                                                                                       |
+| :-------------- | :---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
+| very awa        | Top 5% of images in terms of aesthetic score by [waifu-scorer](https://huggingface.co/Eugeoter/waifu-scorer-v4-beta)                                                                                              |
+| worst aesthetic | All the bottom 5% of images in terms of aesthetic score by [waifu-scorer](https://huggingface.co/Eugeoter/waifu-scorer-v4-beta) and [aesthetic-shadow-v2](https://huggingface.co/shadowlilac/aesthetic-shadow-v2) |
+| ...             | ...                                                                                                                                                                                                               |
+
+## Date Tags
+
+There are two types of date tags: **year tags** and **period tags**. For year tags, use `year xxxx` format, i.e., `year 2021`. For period tags, please refer to the following table:
+
+| Year Range | Period tag |
+| :--------- | :--------- |
+| 2005-2010  | old        |
+| 2011-2014  | early      |
+| 2014-2017  | mid        |
+| 2018-2020  | recent     |
+| 2021-2024  | newest     |
+
+## Dataset
+
+- The latest Danbooru images up to the training date (approximately before 2024-10-23)
+- E621 images [e621-2024-webp-4Mpixel](https://huggingface.co/datasets/NebulaeWis/e621-2024-webp-4Mpixel) dataset on Hugging Face
+
+**Communication**
+
+- **QQ Groups:**
+
+  - 875042008
+  - 914818692
+  - 635772191
+
+- **Discord:** [Laxhar Dream Lab SDXL NOOB](https://discord.com/invite/DKnFjKEEvH)
+
+**How to train a LoRA on v-pred SDXL model**
+
+A tutorial is intended for LoRA trainers based on sd-scripts.
+
+article link: https://civitai.com/articles/8723
+
+**Utility Tool**
+
+Laxhar Lab is training a dedicated ControlNet model for NoobXL, and the models are being released progressively. So far, the normal, depth, and canny have been released.
+
+Model link: https://civitai.com/models/929685
+
+# Model License
+
+This model's license inherits from https://huggingface.co/OnomaAIResearch/Illustrious-xl-early-release-v0 fair-ai-public-license-1.0-sd and adds the following terms. Any use of this model and its variants is bound by this license.
+
+## I. Usage Restrictions
+
+- Prohibited use for harmful, malicious, or illegal activities, including but not limited to harassment, threats, and spreading misinformation.
+- Prohibited generation of unethical or offensive content.
+- Prohibited violation of laws and regulations in the user's jurisdiction.
+
+## II. Commercial Prohibition
+
+We prohibit any form of commercialization, including but not limited to monetization or commercial use of the model, derivative models, or model-generated products.
+
+## III. Open Source Community
+
+Hey everyone! Don’t keep the cool stuff to yourself! 🚀
+
+If you find new tricks, wild art combos, magic prompts, or train fun LoRAs, share them openly! 
+
+Post in DC/TG/X/group chats—let’s all grow together. 
+
+No more secret models/prompts like the old days.
+
+Open sharing = more fun for all! 💡✨
+
+PS: We're not trying to lock things down! Back in the  1.5/n3 days, tons of secret models/prompts popped up (ugh, messy vibes). 
+
+Let’s break that cycle! Sharing = faster progress, wilder ideas, and way more hype.
+
+No gatekeeping—post your 'secret sauce' in public spaces. Everyone wins!  
+
+
+To foster a thriving open-source community,users MUST comply with the following requirements:
+
+- Open source derivative models, merged models, LoRAs, and products based on the above models.
+- Share work details such as synthesis formulas, prompts, and workflows.
+- Follow the fair-ai-public-license to ensure derivative works remain open source.
+
+## IV. Disclaimer
+
+Generated models may produce unexpected or harmful outputs. Users must assume all risks and potential consequences of usage.
+
+# Participants and Contributors
+
+## Participants
+
+- **L_A_X:** [Civitai](https://civitai.com/user/L_A_X) | [Liblib.art](https://www.liblib.art/userpage/9e1b16538b9657f2a737e9c2c6ebfa69) | [Huggingface](https://huggingface.co/LAXMAYDAY)
+- **li_li:** [Civitai](https://civitai.com/user/li_li) | [Huggingface](https://huggingface.co/heziiiii)
+- **nebulae:** [Civitai](https://civitai.com/user/kitarz) | [Huggingface](https://huggingface.co/NebulaeWis)
+- **Chenkin:** [Civitai](https://civitai.com/user/Chenkin) | [Huggingface](https://huggingface.co/windsingai)
+- **Euge:** [Civitai](https://civitai.com/user/Euge_) | [Huggingface](https://huggingface.co/Eugeoter) | [Github](https://github.com/Eugeoter)
+
+## Contributors
+
+- **Narugo1992**: Thanks to [narugo1992](https://github.com/narugo1992) and the [deepghs](https://huggingface.co/deepghs) team for open-sourcing various training sets, image processing tools, and models.
+
+- **Mikubill**: Thanks to [Mikubill](https://github.com/Mikubill) for the [Naifu](https://github.com/Mikubill/naifu) trainer.
+
+- **Onommai**: Thanks to [OnommAI](https://onomaai.com/) for open-sourcing a powerful base model.
+
+- **V-Prediction**: Thanks to the following individuals for their detailed instructions and experiments.
+
+  - adsfssdf
+  - [bluvoll](https://civitai.com/user/bluvoll)
+  - [bvhari](https://github.com/bvhari)
+  - [catboxanon](https://github.com/catboxanon)
+  - [parsee-mizuhashi](https://huggingface.co/parsee-mizuhashi)
+  - [very-aesthetic](https://github.com/very-aesthetic)
+  - [momoura](https://civitai.com/user/momoura)
+  - madmanfourohfour
+  - David
+
+- **Community**: [aria1th261](https://civitai.com/user/aria1th261), [neggles](https://github.com/neggles/neurosis), [sdtana](https://huggingface.co/sdtana), [chewing](https://huggingface.co/chewing), [irldoggo](https://github.com/irldoggo), [reoe](https://huggingface.co/reoe), [kblueleaf](https://civitai.com/user/kblueleaf), [Yidhar](https://github.com/Yidhar), ageless, 白玲可, Creeper, KaerMorh, 吟游诗人, SeASnAkE, [zwh20081](https://civitai.com/user/zwh20081), Wenaka⁧~喵, 稀里哗啦, 幸运二副, 昨日の約, 445, [EBIX](https://civitai.com/user/EBIX), [Sopp](https://huggingface.co/goyishsoyish), [Y_X](https://civitai.com/user/Y_X), [Minthybasis](https://civitai.com/user/Minthybasis), [Rakosz](https://civitai.com/user/Rakosz)

model_index.json

@@ -0,0 +1,41 @@
+{
+  "_class_name": "StableDiffusionXLPipeline",
+  "_diffusers_version": "0.31.0",
+  "feature_extractor": [
+    null,
+    null
+  ],
+  "force_zeros_for_empty_prompt": true,
+  "image_encoder": [
+    null,
+    null
+  ],
+  "scheduler": [
+    "diffusers",
+    "EulerDiscreteScheduler"
+  ],
+  "text_encoder": [
+    "transformers",
+    "CLIPTextModel"
+  ],
+  "text_encoder_2": [
+    "transformers",
+    "CLIPTextModelWithProjection"
+  ],
+  "tokenizer": [
+    "transformers",
+    "CLIPTokenizer"
+  ],
+  "tokenizer_2": [
+    "transformers",
+    "CLIPTokenizer"
+  ],
+  "unet": [
+    "diffusers",
+    "UNet2DConditionModel"
+  ],
+  "vae": [
+    "diffusers",
+    "AutoencoderKL"
+  ]
+}

scheduler/scheduler_config.json

@@ -0,0 +1,25 @@
+{
+  "_class_name": "EulerDiscreteScheduler",
+  "_diffusers_version": "0.31.0",
+  "beta_end": 0.012,
+  "beta_schedule": "scaled_linear",
+  "beta_start": 0.00085,
+  "clip_sample": false,
+  "final_sigmas_type": "zero",
+  "interpolation_type": "linear",
+  "num_train_timesteps": 1000,
+  "prediction_type": "epsilon",
+  "rescale_betas_zero_snr": false,
+  "sample_max_value": 1.0,
+  "set_alpha_to_one": false,
+  "sigma_max": null,
+  "sigma_min": null,
+  "skip_prk_steps": true,
+  "steps_offset": 1,
+  "timestep_spacing": "leading",
+  "timestep_type": "discrete",
+  "trained_betas": null,
+  "use_beta_sigmas": false,
+  "use_exponential_sigmas": false,
+  "use_karras_sigmas": false
+}

text_encoder/config.json

@@ -0,0 +1,24 @@
+{
+  "architectures": [
+    "CLIPTextModel"
+  ],
+  "attention_dropout": 0.0,
+  "bos_token_id": 0,
+  "dropout": 0.0,
+  "eos_token_id": 2,
+  "hidden_act": "quick_gelu",
+  "hidden_size": 768,
+  "initializer_factor": 1.0,
+  "initializer_range": 0.02,
+  "intermediate_size": 3072,
+  "layer_norm_eps": 1e-05,
+  "max_position_embeddings": 77,
+  "model_type": "clip_text_model",
+  "num_attention_heads": 12,
+  "num_hidden_layers": 12,
+  "pad_token_id": 1,
+  "projection_dim": 768,
+  "torch_dtype": "float16",
+  "transformers_version": "4.45.1",
+  "vocab_size": 49408
+}

text_encoder/model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0580de479d979c217e6bc07399e9311e8d681b3a7dc6548b6a41e2ee673bbe40
+size 246144152

text_encoder_2/config.json

@@ -0,0 +1,24 @@
+{
+  "architectures": [
+    "CLIPTextModelWithProjection"
+  ],
+  "attention_dropout": 0.0,
+  "bos_token_id": 0,
+  "dropout": 0.0,
+  "eos_token_id": 2,
+  "hidden_act": "gelu",
+  "hidden_size": 1280,
+  "initializer_factor": 1.0,
+  "initializer_range": 0.02,
+  "intermediate_size": 5120,
+  "layer_norm_eps": 1e-05,
+  "max_position_embeddings": 77,
+  "model_type": "clip_text_model",
+  "num_attention_heads": 20,
+  "num_hidden_layers": 32,
+  "pad_token_id": 1,
+  "projection_dim": 1280,
+  "torch_dtype": "float16",
+  "transformers_version": "4.45.1",
+  "vocab_size": 49408
+}

text_encoder_2/model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6d594c7736feb8ca106cc0cd85e4ca5c5bc56170c5942a0e30903754142ec6c4
+size 1389382176

tokenizer/special_tokens_map.json

@@ -0,0 +1,24 @@
+{
+  "bos_token": {
+    "content": "<|startoftext|>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": "<|endoftext|>",
+  "unk_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer/tokenizer_config.json

@@ -0,0 +1,30 @@
+{
+  "add_prefix_space": false,
+  "added_tokens_decoder": {
+    "49406": {
+      "content": "<|startoftext|>",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "49407": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<|startoftext|>",
+  "clean_up_tokenization_spaces": true,
+  "do_lower_case": true,
+  "eos_token": "<|endoftext|>",
+  "errors": "replace",
+  "model_max_length": 77,
+  "pad_token": "<|endoftext|>",
+  "tokenizer_class": "CLIPTokenizer",
+  "unk_token": "<|endoftext|>"
+}

tokenizer_2/special_tokens_map.json

@@ -0,0 +1,24 @@
+{
+  "bos_token": {
+    "content": "<|startoftext|>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": "!",
+  "unk_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer_2/tokenizer_config.json

@@ -0,0 +1,38 @@
+{
+  "add_prefix_space": false,
+  "added_tokens_decoder": {
+    "0": {
+      "content": "!",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "49406": {
+      "content": "<|startoftext|>",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "49407": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<|startoftext|>",
+  "clean_up_tokenization_spaces": true,
+  "do_lower_case": true,
+  "eos_token": "<|endoftext|>",
+  "errors": "replace",
+  "model_max_length": 77,
+  "pad_token": "!",
+  "tokenizer_class": "CLIPTokenizer",
+  "unk_token": "<|endoftext|>"
+}

unet/config.json

@@ -0,0 +1,72 @@
+{
+  "_class_name": "UNet2DConditionModel",
+  "_diffusers_version": "0.31.0",
+  "act_fn": "silu",
+  "addition_embed_type": "text_time",
+  "addition_embed_type_num_heads": 64,
+  "addition_time_embed_dim": 256,
+  "attention_head_dim": [
+    5,
+    10,
+    20
+  ],
+  "attention_type": "default",
+  "block_out_channels": [
+    320,
+    640,
+    1280
+  ],
+  "center_input_sample": false,
+  "class_embed_type": null,
+  "class_embeddings_concat": false,
+  "conv_in_kernel": 3,
+  "conv_out_kernel": 3,
+  "cross_attention_dim": 2048,
+  "cross_attention_norm": null,
+  "down_block_types": [
+    "DownBlock2D",
+    "CrossAttnDownBlock2D",
+    "CrossAttnDownBlock2D"
+  ],
+  "downsample_padding": 1,
+  "dropout": 0.0,
+  "dual_cross_attention": false,
+  "encoder_hid_dim": null,
+  "encoder_hid_dim_type": null,
+  "flip_sin_to_cos": true,
+  "freq_shift": 0,
+  "in_channels": 4,
+  "layers_per_block": 2,
+  "mid_block_only_cross_attention": null,
+  "mid_block_scale_factor": 1,
+  "mid_block_type": "UNetMidBlock2DCrossAttn",
+  "norm_eps": 1e-05,
+  "norm_num_groups": 32,
+  "num_attention_heads": null,
+  "num_class_embeds": null,
+  "only_cross_attention": false,
+  "out_channels": 4,
+  "projection_class_embeddings_input_dim": 2816,
+  "resnet_out_scale_factor": 1.0,
+  "resnet_skip_time_act": false,
+  "resnet_time_scale_shift": "default",
+  "reverse_transformer_layers_per_block": null,
+  "sample_size": 128,
+  "time_cond_proj_dim": null,
+  "time_embedding_act_fn": null,
+  "time_embedding_dim": null,
+  "time_embedding_type": "positional",
+  "timestep_post_act": null,
+  "transformer_layers_per_block": [
+    1,
+    2,
+    10
+  ],
+  "up_block_types": [
+    "CrossAttnUpBlock2D",
+    "CrossAttnUpBlock2D",
+    "UpBlock2D"
+  ],
+  "upcast_attention": null,
+  "use_linear_projection": true
+}

unet/diffusion_pytorch_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d4d0ff7282ad600456ba0d920221af844fda4c5d1f188b59239f0b8187ff190e
+size 5135149760

vae/config.json

@@ -0,0 +1,38 @@
+{
+  "_class_name": "AutoencoderKL",
+  "_diffusers_version": "0.31.0",
+  "_name_or_path": "../sdxl-vae/",
+  "act_fn": "silu",
+  "block_out_channels": [
+    128,
+    256,
+    512,
+    512
+  ],
+  "down_block_types": [
+    "DownEncoderBlock2D",
+    "DownEncoderBlock2D",
+    "DownEncoderBlock2D",
+    "DownEncoderBlock2D"
+  ],
+  "force_upcast": true,
+  "in_channels": 3,
+  "latent_channels": 4,
+  "latents_mean": null,
+  "latents_std": null,
+  "layers_per_block": 2,
+  "mid_block_add_attention": true,
+  "norm_num_groups": 32,
+  "out_channels": 3,
+  "sample_size": 1024,
+  "scaling_factor": 0.13025,
+  "shift_factor": null,
+  "up_block_types": [
+    "UpDecoderBlock2D",
+    "UpDecoderBlock2D",
+    "UpDecoderBlock2D",
+    "UpDecoderBlock2D"
+  ],
+  "use_post_quant_conv": true,
+  "use_quant_conv": true
+}

vae/diffusion_pytorch_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9d3aca1a278ed7262b9c5d13fa232c088b039a05abbce27c45b5d2c8cc60df1d
+size 167335342