|
|
--- |
|
|
license: other |
|
|
license_name: flux-1-dev-non-commercial-license |
|
|
license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE. |
|
|
language: |
|
|
- en |
|
|
pipeline_tag: text-to-image |
|
|
tags: |
|
|
- LoRA |
|
|
- Stable Diffusion |
|
|
- image-generation |
|
|
- Flux |
|
|
--- |
|
|
This repository provides a checkpoint with trained LoRA for |
|
|
[FLUX.1-dev model](https://huggingface.co/black-forest-labs/FLUX.1-dev) by Black Forest Labs |
|
|
[<img src="https://github.com/XLabs-AI/x-flux/blob/main/assets/readme/light/join-our-discord-rev1.png?raw=true">](https://discord.gg/FHY2guThfy) |
|
|
|
|
|
 |
|
|
|
|
|
# Training details |
|
|
[XLabs AI](https://github.com/XLabs-AI) team is happy to publish fune-tuning Flux scripts, including: |
|
|
|
|
|
- **LoRA** π₯ |
|
|
- **ControlNet** π₯ |
|
|
|
|
|
[See our github](https://github.com/XLabs-AI/x-flux) for train script and train configs. |
|
|
|
|
|
# Training Dataset |
|
|
Dataset has the following format for the training process: |
|
|
|
|
|
``` |
|
|
βββ images/ |
|
|
β βββ 1.png |
|
|
β βββ 1.json |
|
|
β βββ 2.png |
|
|
β βββ 2.json |
|
|
β βββ ... |
|
|
``` |
|
|
A .json file contains "caption" field with a text prompt. |
|
|
|
|
|
Thank https://civitai.com/user/dobrosketchkun and https://civitai.com/user/sadxzero for datasets for loras |
|
|
|
|
|
# Inference |
|
|
## mjv6_lora |
|
|
```bash |
|
|
python3 main.py \ |
|
|
--prompt "A handsome man in a suit, 25 years old, cool, futuristic" \ |
|
|
--lora_repo_id XLabs-AI/flux-lora-collection --lora_name mjv6_lora.safetensors \ |
|
|
--device cuda:4 --offload --use_lora --model_type flux-dev-fp8 --width 1024 --height 1024 |
|
|
``` |
|
|
|
|
|
 |
|
|
|
|
|
```bash |
|
|
python3 main.py \ |
|
|
--prompt "A girl in a suit covered with bold tattoos and holding a vest pistol, beautiful woman, 25 years old, cool, future fantasy, turquoise & light orange ping curl hair" \ |
|
|
--lora_repo_id XLabs-AI/flux-lora-collection --lora_name mjv6_lora.safetensors \ |
|
|
--device cuda --offload --use_lora --model_type flux-dev-fp8 --width 1024 --height 1024 |
|
|
``` |
|
|
|
|
|
 |
|
|
|
|
|
|
|
|
lora.safetensors falls under the [FLUX.1 [dev]](https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md) Non-Commercial License<br/> |