naomiKenKorem commited on
Commit
b1af4fc
·
verified ·
1 Parent(s): 9c81a25

Upload 6 files

Browse files
.gitattributes CHANGED
@@ -33,3 +33,8 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ samples/sample_0.gif filter=lfs diff=lfs merge=lfs -text
37
+ samples/sample_1.gif filter=lfs diff=lfs merge=lfs -text
38
+ samples/sample_2.gif filter=lfs diff=lfs merge=lfs -text
39
+ samples/sample_3.gif filter=lfs diff=lfs merge=lfs -text
40
+ samples/sample_4.gif filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - ltx-video
4
+ - image-to-video
5
+ pinned: true
6
+ language:
7
+ - en
8
+ license: other
9
+ pipeline_tag: text-to-video
10
+ library_name: diffusers
11
+ ---
12
+
13
+ # LTXV_13B_LoRA_pose_tmp
14
+
15
+ This is an ic-lora on top of [`LTXV_13B_097_DEV`](https://huggingface.co/Lightricks/LTX-Video/blob/main/ltxv-13b-0.9.7-dev.safetensors) trained on custom data.
16
+
17
+ ## Model Details
18
+
19
+ - **Base Model:** [`LTXV_13B_097_DEV`](https://huggingface.co/Lightricks/LTX-Video/blob/main/ltxv-13b-0.9.7-dev.safetensors)
20
+ - **Training Type:** IC LoRA fine-tuning
21
+ - **Training Steps:** 4000
22
+ - **Learning Rate:** 0.0002
23
+ - **Batch Size:** 1
24
+
25
+ ## Sample Outputs
26
+
27
+ | | | |
28
+ |:---:|:---:|:---:|
29
+ | ![example1](./samples/sample_0.gif)<br><details style="max-width: 300px; margin: auto;"><summary>Prompt</summary>a human walking down the street, talking to his friend</details> | ![example2](./samples/sample_1.gif)<br><details style="max-width: 300px; margin: auto;"><summary>Prompt</summary>a man sitting on the sofa, reading a book</details> | ![example3](./samples/sample_2.gif)<br><details style="max-width: 300px; margin: auto;"><summary>Prompt</summary>a man eating an icecream on the beach</details> |
30
+ | | |
31
+ |:---:|:---:|
32
+ | ![example4](./samples/sample_3.gif)<br><details style="max-width: 300px; margin: auto;"><summary>Prompt</summary>a man sitting on the sofa, reading a book</details> | ![example5](./samples/sample_4.gif)<br><details style="max-width: 300px; margin: auto;"><summary>Prompt</summary>a person dancing in the rain</details> |
33
+
34
+ ## Usage
35
+
36
+ This model is designed to be used with the LTXV (Lightricks Text-to-Video) pipeline.
37
+
38
+ ### 🔌 Using Trained LoRAs in ComfyUI
39
+ In order to use the trained lora in comfy:
40
+ 1. Copy the comfyui trained LoRA weights to the `models/loras` folder in your ComfyUI installation.
41
+ 2. Use ic-lora-pose-control.json from [official LTXV ComfyUI repository](https://github.com/Lightricks/ComfyUI-LTXVideo)
42
+
43
+
44
+
45
+
46
+
47
+ This model inherits the license of the base model ([`LTXV_13B_097_DEV`](https://huggingface.co/Lightricks/LTX-Video/blob/main/ltxv-13b-0.9.7-dev.safetensors)).
48
+
49
+ ## Acknowledgments
50
+
51
+ - Base model by [Lightricks](https://huggingface.co/Lightricks)
52
+ - Training infrastructure: [LTX-Video-Trainer](https://github.com/Lightricks/ltx-video-trainer)
samples/sample_0.gif ADDED

Git LFS Details

  • SHA256: cbe0de95779e15113acbefc0bbbedf01f7ff7790e54624d7290a1624834faaaf
  • Pointer size: 133 Bytes
  • Size of remote file: 46.9 MB
samples/sample_1.gif ADDED

Git LFS Details

  • SHA256: 220ecd1cffe3badecd573e7ad3c954b872bea7ecbafecedaafb11b40f791bde1
  • Pointer size: 133 Bytes
  • Size of remote file: 32.6 MB
samples/sample_2.gif ADDED

Git LFS Details

  • SHA256: cc93331f88c51e741ad1bacae097b252637dc29f4fcc1a689e6265391eea0831
  • Pointer size: 133 Bytes
  • Size of remote file: 45.3 MB
samples/sample_3.gif ADDED

Git LFS Details

  • SHA256: 8502e0e7be5cfc6e2b217c2803b97d211ddbd23e544ffaf2874df1aacd02489d
  • Pointer size: 133 Bytes
  • Size of remote file: 21.5 MB
samples/sample_4.gif ADDED

Git LFS Details

  • SHA256: ac7a88e756ad15e04f645f69b3d8b4b0f2dd61a7ee39924f18f63ddfc8a926bf
  • Pointer size: 133 Bytes
  • Size of remote file: 10.3 MB