---
license: apache-2.0
base_model:
- Lightricks/LTX-Video
library_name: gguf

tags:
- video
- video-generation
pipeline_tag: image-to-video
---

Comfyui doesnt natively support these Quants yet but there is a workaround:

First of all you need to load the vae, which you can download in this repo too and then

we need to edit this file Comfyui/comfy/ldm/lightricks/model.py

and change the __init__ function for class LTXVModel(torch.nn.Module):

from this: 


    def __init__(self,
                 in_channels=128,
                 cross_attention_dim=2048,
                 attention_head_dim=64,
                 num_attention_heads=32,

                 caption_channels=4096,
                 num_layers=28,


                 positional_embedding_theta=10000.0,
                 positional_embedding_max_pos=[20, 2048, 2048],
                 causal_temporal_positioning=False,
                 vae_scale_factors=(8, 32, 32),
                 dtype=None, device=None, operations=None, **kwargs):


to this:

    def __init__(self,
                 in_channels=128,
                 cross_attention_dim=4096,
                 attention_head_dim=128, 
                 num_attention_heads=32,

                 caption_channels=4096,
                 num_layers=48,

                 
                 positional_embedding_theta=10000.0,
                 positional_embedding_max_pos=[20, 2048, 2048],
                 causal_temporal_positioning=False,
                 vae_scale_factors=(8, 32, 32),
                 dtype=None, device=None, operations=None, **kwargs):


If you want to use the 2b again just revert it and restart. After a restart the 13b model should work with this and the vae i uploaded. 

This is a direct GGUF conversion of [Lightricks/ltxv-13b-0.9.7-dev](https://huggingface.co/Lightricks/LTX-Video)

All quants are created from the FP32 base file, though I only uploaded the Q8_0 and less, if you want the F16 or BF16 one I would upload it per request. 

The model files can be used with the [ComfyUI-GGUF](https://github.com/city96/ComfyUI-GGUF) custom node.

Place model files in `ComfyUI/models/unet` - see the GitHub readme for further install instructions.

Please refer to [this chart](https://github.com/ggerganov/llama.cpp/blob/master/examples/perplexity/README.md#llama-3-8b-scoreboard) for a basic overview of quantization types.

For conversion I used the conversion scripts from [city96](https://huggingface.co/city96)