matanby commited on
Commit
88378ac
·
verified ·
1 Parent(s): 6ebf8b5

Add README.

Browse files
Files changed (3) hide show
  1. .gitattributes +1 -0
  2. README.md +54 -0
  3. samples/sample1.gif +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ samples/sample1.gif filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,54 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - ltx-video
4
+ - image-to-video
5
+ - text-to-video
6
+ pinned: true
7
+ language:
8
+ - en
9
+ license: other
10
+ pipeline_tag: text-to-video
11
+ library_name: diffusers
12
+ base_model:
13
+ - Lightricks/LTX-Video-0.9.8-dev
14
+ ---
15
+
16
+ # LTX Video ICLoRA Detailer 13B 0.9.7
17
+
18
+ ![Sample](samples/sample1.gif)
19
+
20
+ This is a video detailer model on top of [`LTXV_13B_098_DEV`](https://huggingface.co/Lightricks/LTX-Video/blob/main/ltxv-13b-0.9.8-dev.safetensors) trained on custom data.
21
+
22
+ ## What is In-Context LoRA (IC LoRA)?
23
+
24
+ IC LoRA is a method that enables adding video context into the video generation process. This approach allows for video-to-video control on top of the text-to-video model, providing more precise control over the generated content by conditioning the model on reference video frames during inference.
25
+
26
+ comfy compatible model: [ltxv-098-ic-lora-detailer-comfyui.safetensors](ltxv-098-ic-lora-detailer-comfyui.safetensors)
27
+
28
+
29
+ diffusers compatible model:[ltxv-098-ic-lora-detailer-diffusers.safetensors](ltxv-098-ic-lora-detailer-diffusers.safetensors)
30
+
31
+ ## License
32
+
33
+ For licensing information, please refer to the [LTXV Open Weights License](LTX-Video-Open-Weights-License-0.X.txt).
34
+ ## Model Details
35
+
36
+ - **Base Model:** [`LTXV_13B_098_DEV`](https://huggingface.co/Lightricks/LTX-Video/blob/main/ltxv-13b-0.9.8-dev.safetensors)
37
+ - **Training Type:** IC LoRA training
38
+ - **Learning Rate:** 0.0002
39
+
40
+
41
+ ## Usage
42
+
43
+ This model is designed to be used with the LTXV (Lightricks Text-to-Video) pipeline.
44
+
45
+ ### 🔌 Using Trained LoRAs in ComfyUI
46
+ In order to use the trained lora in comfy:
47
+ 1. Copy the comfyui trained LoRA weights to the `models/loras` folder in your ComfyUI installation.
48
+ 2. Use ic_lora/ic-lora.json from [official LTXV ComfyUI repository](https://github.com/Lightricks/ComfyUI-LTXVideo)
49
+
50
+
51
+ ## Acknowledgments
52
+
53
+ - Base model by [Lightricks](https://huggingface.co/Lightricks)
54
+ - Training infrastructure: [LTX-Video-Trainer](https://github.com/Lightricks/ltx-video-trainer)
samples/sample1.gif ADDED

Git LFS Details

  • SHA256: d4fe6ac63bdfd0ac54ba04d84abb5b1d89b7209e527729442640ff56e5a09da7
  • Pointer size: 133 Bytes
  • Size of remote file: 55 MB