LLMs in EXL3 format that fit into 32GB VRAM
DeusImperator
DeusImperator
AI & ML interests
None yet
Recent Activity
updated
a collection
2 days ago
EXL3 models for 32GB VRAM
updated
a model
2 days ago
DeusImperator/L3.3-GeneticLemonade-Unleashed-v3-70B_exl3_3.0bpw_H6
published
a model
3 days ago
DeusImperator/L3.3-GeneticLemonade-Unleashed-v3-70B_exl3_3.0bpw_H6
Organizations
None yet
Collections
5
70B LLMs that fit in 24GB VRAM with over 16k context (with exl2 Q4 cache)
-
DeusImperator/Midnight-Miqu-70B-v1.5_exl2_2.4bpw_rpcal
Text Generation • Updated • 25 • 1 -
DeusImperator/Midnight-Miqu-70B-v1.5_exl2_2.4bpw_rpcal_mk2
Text Generation • Updated • 25 -
DeusImperator/Midnight-Miqu-70B-v1.5_exl2_2.4bpw
Text Generation • Updated • 18 -
DeusImperator/Dark-Miqu-70B_exl2_2.4bpw
Text Generation • Updated • 14
models
54
DeusImperator/L3.3-GeneticLemonade-Unleashed-v3-70B_exl3_3.0bpw_H6
Text Generation
•
Updated
•
2
DeusImperator/L3.3-MS-Nevoria-70b_exl3_3.0bpw_H6
Text Generation
•
Updated
•
100
DeusImperator/Legion-V2.1-LLaMa-70B_exl3_3.0bpw_H6
Text Generation
•
Updated
•
8
DeusImperator/Qwen2.5-32B-Instruct_exl2_4.7bpw_rpcal_mk2
Text Generation
•
Updated
•
21
DeusImperator/Forgotten-Abomination-24B-v1.2_exl2_6.5bpw_L
Updated
•
3
•
1
DeusImperator/Forgotten-Safeword-24B_exl2_6.5bpw_L
Updated
•
20
•
1
DeusImperator/Mistral-Small-24B-Instruct-2501_exl2_6.5bpw_L
Updated
•
8
•
6
DeusImperator/Dumpling-Qwen2.5-32B_exl2_4.5bpw_L
Text Generation
•
Updated
•
13
DeusImperator/EVA-Rombos1-Qwen2.5-32B_exl2_4.5bpw_L
Text Generation
•
Updated
•
10
DeusImperator/DeepSeek-R1-Distill-Qwen-32B_exl2_4.5bpw_L
Text Generation
•
Updated
•
13
•
1
datasets
0
None public yet