EXL3 models for 32GB VRAM - a DeusImperator Collection

DeusImperator 's Collections

EXL3 models for 32GB VRAM

EXL2 70B for 24GB VRAM

Small models 8bpw EXL2 quants

Mid-range models exl2 quants

Exl2 8bpw MAX quants

EXL3 models for 32GB VRAM

updated 3 days ago

LLMs in EXL3 format that fit into 32GB VRAM

DeusImperator/Legion-V2.1-LLaMa-70B_exl3_3.0bpw_H6

Text Generation • Updated 15 days ago • 8
DeusImperator/L3.3-MS-Nevoria-70b_exl3_3.0bpw_H6

Text Generation • Updated 11 days ago • 100
DeusImperator/L3.3-GeneticLemonade-Unleashed-v3-70B_exl3_3.0bpw_H6

Text Generation • Updated 3 days ago • 2