Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,68 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: mit
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
tags:
|
| 4 |
+
- stable diffusion
|
| 5 |
+
- animatediff
|
| 6 |
+
- motion lora
|
| 7 |
+
language:
|
| 8 |
+
- en
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
- [Walking motion LoRAs for Animatediff v2](#walking-motion-loras-for-animatediff-v2)
|
| 12 |
+
- [File summary](#file-summary)
|
| 13 |
+
- [General recommendation](#general-recommendation)
|
| 14 |
+
- [Details and examples](#details-and-examples)
|
| 15 |
+
- [Walking front view](#walking-front-view)
|
| 16 |
+
- [Walking back view](#walking-back-view)
|
| 17 |
+
- [Walking right view](#walking-right-view)
|
| 18 |
+
- [Walking left view](#walking-left-view)
|
| 19 |
+
|
| 20 |
+
# Walking motion LoRAs for Animatediff v2
|
| 21 |
+
|
| 22 |
+
## File summary
|
| 23 |
+
|
| 24 |
+
| Name | Compatible Motion Model | Base AR (w/h) | Frames | input videos |
|
| 25 |
+
| ---------------------------------------------------------- | ----------------------- | ------------- | ------ | ------------ |
|
| 26 |
+
| 1900_cseti_6931403_walking-frontview-8vid_mv2.safetensors | v2 | (3:2) | 16 | 8 |
|
| 27 |
+
| 1600_cseti_1065173_walking-backview-8vid_mv2.safetensors | v2 | (3:2) | 16 | 8 |
|
| 28 |
+
| 1100_cseti_6134549_walking-left-sideview-3vid.safetensors | v2 | (3:2) | 16 | 3 |
|
| 29 |
+
| 1100_cseti_8836021_walking-right-sideview-3vid.safetensors | v2 | (3:2) | 16 | 3 |
|
| 30 |
+
|
| 31 |
+
|
| 32 |
+
## General recommendation
|
| 33 |
+
|
| 34 |
+
- These are finetuned on a v2 model. They work also with AnimateLCM but don't work with v3 models
|
| 35 |
+
- Animatediff v3 adapter lora is recommended regardless they are v2 models
|
| 36 |
+
- If you want more motion try incrasing the scale multival (e.g. to 1.2)
|
| 37 |
+
- I recommend using the above Base AR (Aspect ratio) for inference
|
| 38 |
+
- - Try playing with the lora strength and scale multival like increasing the scale multival and lowering the lora strength.
|
| 39 |
+
|
| 40 |
+
## Details and examples
|
| 41 |
+
|
| 42 |
+
### Walking front view
|
| 43 |
+
- Recommended keywords: front-view, walking
|
| 44 |
+
- LoRA strength: 0.8-1.0
|
| 45 |
+
- scale multival / motion scale: 1.0-1.2
|
| 46 |
+
|
| 47 |
+
<video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00054.mp4" title="front view"></video>
|
| 48 |
+
|
| 49 |
+
### Walking back view
|
| 50 |
+
- Recommended keywords: back-view, walking
|
| 51 |
+
- LoRA strength: 0.8-1.0
|
| 52 |
+
- scale multival / motion scale: 1.0-1.2
|
| 53 |
+
|
| 54 |
+
<video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00063.mp4" title="back view"></video>
|
| 55 |
+
|
| 56 |
+
### Walking right view
|
| 57 |
+
- Recommended keywords: side-view, facing right, walking
|
| 58 |
+
- LoRA strength: 0.5-1.0
|
| 59 |
+
- scale multival / motion scale: 1.0-1.2
|
| 60 |
+
|
| 61 |
+
<video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00052.mp4" title="right view"></video>
|
| 62 |
+
|
| 63 |
+
### Walking left view
|
| 64 |
+
- Recommended keywords: side-view, facing left, walking
|
| 65 |
+
- LoRA strength: 0.5-1.0
|
| 66 |
+
- scale multival / motion scale: 1.0-1.2
|
| 67 |
+
|
| 68 |
+
<video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00048.mp4" title="left view"></video>
|