Hugging Face's logo
Sayak Paul's picture
380 52 197

Sayak Paul

sayakpaul
taimur1871's profile picture Fatihh's profile picture kd-tensor's profile picture
·
https://sayak.dev

AI & ML interests

Diffusion models, representation learning

Recent Activity

posted an update 1 day ago
Fast LoRA inference for Flux with Diffusers and PEFT 🚨 There are great materials that demonstrate how to optimize inference for popular image generation models, such as Flux. However, very few cover how to serve LoRAs fast, despite LoRAs being an inseparable part of their adoption. In our latest post, @BenjaminB and I show different techniques to optimize LoRA inference for the Flux family of models for image generation. Our recipe includes the use of: 1. `torch.compile` 2. Flash Attention 3 (when compatible) 3. Dynamic FP8 weight quantization (when compatible) 4. Hotswapping for avoiding recompilation during swapping new LoRAs 🤯 We have tested our recipe with Flux.1-Dev on both H100 and RTX 4090. We achieve at least a *2x speedup* in either of the GPUs. We believe our recipe is grounded in the reality of how LoRA-based use cases are generally served. So, we hope this will be beneficial to the community 🤗 Even though our recipe was tested primarily with NVIDIA GPUs, it should also work with AMD GPUs. Learn the details and the full code here: https://huggingface.co/blog/lora-fast
commented on their article 1 day ago
Fast LoRA inference for Flux with Diffusers and PEFT
new activity 2 days ago
black-forest-labs/FLUX.1-Kontext-dev:pipe.to("cuda") runs super slow, is it expected?
View all activity

Organizations

Hugging Face's profile picture 🧨Diffusers's profile picture TensorFlow TPU's profile picture Hugging Face Internal Testing Organization's profile picture All Things ViTs's profile picture Probing ViTs's profile picture Evaluation on the Hub's profile picture Instruction-tuned Diffusion Models's profile picture JAX ♥️ Diffusers 🧨's profile picture (De)fusing's profile picture Huggingface Projects's profile picture Keras Dreambooth Event's profile picture Hugging Face OSS Metrics's profile picture Deploy HF TF ViTs's profile picture Open Generative AI's profile picture UniDiffuser Testing's profile picture Personal Coding Assistant's profile picture Diffusers Demo at ICCV 2023's profile picture huggingPartyParis's profile picture Latent Consistency's profile picture ZeroGPU Explorers's profile picture SPRIGHT's profile picture PEFT's profile picture NYU VisionX's profile picture Social Post Explorers's profile picture MaPO's profile picture diffusers-internal-dev's profile picture AuraFlow's profile picture lawrence's profile picture Optimum Internal Testing's profile picture Diffusion Guidance's profile picture syn-t2i's profile picture Hugging Face FineVideo's profile picture DDUF's profile picture HunyuanVideo Community's profile picture Finetrainers's profile picture Diffusion CoT's profile picture Cinematic T2V's profile picture Diffusers Internal Demos's profile picture