File size: 1,609 Bytes
a92e473 b69e4be a92e473 b69e4be a92e473 a2df62a b15f521 a2df62a b15f521 a2df62a a92e473 2417bc4 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 |
---
license: apache-2.0
---
# ImageDream-diffusers Model Card
This is a port of https://huggingface.co/Peng-Wang/ImageDream into diffusers.
And get ported weights from https://huggingface.co/ashawkey/imagedream-ipmv-diffuser
In ashawkey's work, UNet did not ported to diffusers.
This work has been fully ported to diffusers, including UNet.
And separated the IP-adapter-plus from the unet.
## Diffusers
```python
import torch
from diffusers import DiffusionPipeline
from diffusers.utils import make_image_grid
from PIL import Image
pipe = DiffusionPipeline.from_pretrained(
"kiigii/imagedream-ipmv-diffusers",
torch_dtype=torch.float16,
trust_remote_code=True,
)
pipe.load_ip_adapter()
pipe.to("cude")
prompt = "" # no need to input prompt
image = Image.open(...)
mv_images = pipe(
prompt=prompt,
ip_adapter_image=image,
guidance_scale=5,
num_inference_steps=30,
elevation=0,
num_images_per_prompt=1
).images
mv_grid = make_image_grid(mv_images[:4], 2, 2)
mv_grid.save("mv_image.png")
```
## Citation
```
@article{wang2023imagedream,
title={ImageDream: Image-Prompt Multi-view Diffusion for 3D Generation},
author={Wang, Peng and Shi, Yichun},
journal={arXiv preprint arXiv:2312.02201},
year={2023}
}
```
## Misuse, Malicious Use, and Out-of-Scope Use
The model should not be used to intentionally create or disseminate images that create hostile or alienating environments for people. This includes generating images that people would foreseeably find disturbing, distressing, or offensive; or content that propagates historical or current stereotypes. |