Remade-AI
/

Animal-Documentary

+---
+license: apache-2.0
+language:
+- en
+base_model:
+- Wan-AI/Wan2.1-T2V-14B
+pipeline_tag: text-to-video
+tags:
+- text-to-video
+- text-to-image
+- lora
+- diffusers
+- template:diffusion-lora
+widget:
+- text: >-
+      4n1m4l animal documentary The video shows a close-up of a chimpanzee grooming its infant, set against the backdrop of a lush green jungle.
+  output:
+    url: example_videos/animal1.mp4
+- text: >-
+      4n1m4l animal documentary The video shows a majestic lion resting in tall savanna grass, its golden mane catching the sunlight.
+  output:
+    url: example_videos/animal2.mp4
+- text: >-
+      4n1m4l animal documentary The video shows a tiger mother and her cub walking through a grassy field. The mother is larger and has more prominent stripes. The cub is smaller and its stripes are less distinct. They are both walking in the same direction.
+  output:
+    url: example_videos/animal3.mp4
+- text: >-
+      4n1m4l animal documentary  a close-up of a scarlet macaw. The bird is perched on a branch and is facing to the left of the camera. Its feathers are a vibrant red, with blue and green accents. The macaw's large, black beak is slightly open, and its eyes are closed. The background of the video is a blurred out green foliage.
+  output:
+    url: example_videos/animal4.mp4
+---
+<div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
+  <h1 style="color: #24292e; margin-top: 0;">Animal Documentary LoRA for Wan2.1 14B T2V</h1>
+  <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
+    <h2 style="color: #24292e; margin-top: 0;">Overview</h2>
+    <p>This LoRA is trained on the Wan2.1 14B T2V model and allows you to generate videos in the style of an animal documentary!</p>
+  </div>
+  <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
+    <h2 style="color: #24292e; margin-top: 0;">Features</h2>
+    <ul style="margin-bottom: 0;">
+      <li>Trained on the Wan2.1 14B T2V base model</li>
+      <li>Consistent results across different object types</li>
+      <li>Simple prompt structure that's easy to adapt</li>
+    </ul>
+  </div>
+  <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
+    <h2 style="color: #24292e; margin-top: 0;">Community</h2>
+    <ul style="margin-bottom: 0;">
+      <li><b>Discord:</b> <a href="https://discord.com/invite/7tsKMCbNFC" style="color: #0366d6; text-decoration: none;">Join our community</a> to generate videos with this LoRA for free</li>
+      <li><b>Request LoRAs:</b> We're training and open-sourcing Wan2.1 LoRAs for free - join our Discord to make requests!</li>
+    </ul>
+  </div>
+</div>
+<Gallery />
+# Model File and Inference Workflow
+## 📥 Download Links:
+- [animal_doc_5_epochs.safetensors](./animal_doc_5_epochs.safetensors) - LoRA Model File
+- [wan_txt2vid_lora_workflow.json](./workflow/wan_txt2vid_lora_workflow.json) - Wan T2V with LoRA Workflow for ComfyUI
+---
+<div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
+  <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
+    <h2 style="color: #24292e; margin-top: 0;">Recommended Settings</h2>
+    <ul style="margin-bottom: 0;">
+      <li><b>LoRA Strength:</b> 1.0</li>
+      <li><b>Embedded Guidance Scale:</b> 6.0</li>
+      <li><b>Flow Shift:</b> 5.0</li>
+    </ul>
+  </div>
+  <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
+    <h2 style="color: #24292e; margin-top: 0;">Trigger Words</h2>
+    <p>The key trigger phrase is: <code style="background-color: #f0f0f0; padding: 3px 6px; border-radius: 4px;">4n1m4l animal documentary</code></p>
+  </div>
+  <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
+    <h2 style="color: #24292e; margin-top: 0;">Prompt Template</h2>
+    <p>For prompting, check out the example prompts; this way of prompting seems to work very well.</p>
+  <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
+    <h2 style="color: #24292e; margin-top: 0;">ComfyUI Workflow</h2>
+    <p>This LoRA works with a modified version of <a href="https://github.com/kijai/ComfyUI-WanVideoWrapper/blob/main/example_workflows/wanvideo_T2V_example_02.json" style="color: #0366d6; text-decoration: none;">Kijai's Wan Video Wrapper workflow</a>. The main modification is adding a Wan LoRA node connected to the base model.</p>
+    <img src="./workflow/workflow_screenshot.png" style="width: 100%; border-radius: 8px; margin: 15px 0; box-shadow: 0 4px 8px rgba(0,0,0,0.1);">
+    <p>See the Downloads section above for the modified workflow.</p>
+  </div>
+</div>
+<div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
+  <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
+    <h2 style="color: #24292e; margin-top: 0;">Model Information</h2>
+    <p>The model weights are available in Safetensors format. See the Downloads section above.</p>
+  </div>
+  <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
+    <h2 style="color: #24292e; margin-top: 0;">Training Details</h2>
+    <ul style="margin-bottom: 0;">
+      <li><b>Base Model:</b> Wan2.1 14B T2V</li>
+      <li><b>Training Data:</b> Trained on 4 minutes of video comprised of 51 short clips (each clip captioned separately) of various animal documentaries.</li>
+      <li><b> Epochs:</b> 5</li>
+    </ul>
+  </div>
+  <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
+    <h2 style="color: #24292e; margin-top: 0;">Additional Information</h2>
+    <p>Training was done using <a href="https://github.com/tdrussell/diffusion-pipe" style="color: #0366d6; text-decoration: none;">Diffusion Pipe for Training</a></p>
+  </div>
+  <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
+    <h2 style="color: #24292e; margin-top: 0;">Acknowledgments</h2>
+    <p style="margin-bottom: 0;">Special thanks to Kijai for the ComfyUI Wan Video Wrapper and tdrussell for the training scripts!</p>
+  </div>
+</div>