pinky-lora-v5 / README.md
guillepinto's picture
Add generated example (#2)
80a47a3 verified
metadata
tags:
  - stable-diffusion-xl
  - stable-diffusion-xl-diffusers
  - diffusers-training
  - text-to-image
  - diffusers
  - lora
  - template:sd-lora
widget:
  - text: a cartoon graffiti character of TOK
  - text: >-
      a surreal illustration of <s0><s1>, a cartoon graffiti character floating
      in a cosmic background, in the style of <s0><s1>
    output:
      url: images/example_l8irlowpc.png
  - text: >-
      a mural featuring a cartoon graffiti character of <s0><s1> spraying
      vibrant colors on a brick wall, in the style of <s0><s1>
    output:
      url: images/example_11tsa7rpk.png
base_model: stabilityai/stable-diffusion-xl-base-1.0
instance_prompt: a cartoon graffiti character of TOK
license: openrail++

SDXL LoRA DreamBooth - guillepinto/pinky-lora-v5

Prompt
a surreal illustration of <s0><s1>, a cartoon graffiti character floating in a cosmic background, in the style of <s0><s1>
Prompt
a mural featuring a cartoon graffiti character of <s0><s1> spraying vibrant colors on a brick wall, in the style of <s0><s1>

Model description

These are guillepinto/pinky-lora-v5 LoRA adaption weights for stabilityai/stable-diffusion-xl-base-1.0.

Download model

Use it with UIs such as AUTOMATIC1111, Comfy UI, SD.Next, Invoke

Use it with the 🧨 diffusers library

from diffusers import AutoPipelineForText2Image
import torch

pipeline = AutoPipelineForText2Image.from_pretrained('stabilityai/stable-diffusion-xl-base-1.0', torch_dtype=torch.float16).to('cuda')
pipeline.load_lora_weights('guillepinto/pinky-lora-v5', weight_name='pytorch_lora_weights.safetensors')

image = pipeline('a cartoon graffiti character of TOK').images[0]

For more details, including weighting, merging and fusing LoRAs, check the documentation on loading LoRAs in diffusers

Trigger words

You should use a cartoon graffiti character of TOK to trigger the image generation.

Details

All Files & versions.

The weights were trained using 🧨 diffusers Advanced Dreambooth Training Script.

LoRA for the text encoder was enabled. False.

Pivotal tuning was enabled: False.

Special VAE used for training: madebyollin/sdxl-vae-fp16-fix.