Models
Datasets
Spaces
Docs
Enterprise
Pricing
Log In
Sign Up

DeusImperator's picture

4

DeusImperator

DeusImperator

med4u's profile picture

nephepritou's profile picture

dinerburger's profile picture

·

AI & ML interests

None yet

Organizations

None yet

DeusImperator 's collections 5

EXL3 models for 32GB VRAM

LLMs in EXL3 format that fit into 32GB VRAM

DeusImperator/Legion-V2.1-LLaMa-70B_exl3_3.0bpw_H6

Text Generation • 14B • Updated May 28 • 5
DeusImperator/L3.3-MS-Nevoria-70b_exl3_3.0bpw_H6

Text Generation • 14B • Updated Jun 1 • 2
DeusImperator/L3.3-GeneticLemonade-Unleashed-v3-70B_exl3_3.0bpw_H6

Text Generation • 14B • Updated Jun 9 • 6
DeusImperator/Strawberrylemonade-70B-v1.2_exl3_3.0bpw_H6

Text Generation • 14B • Updated Jun 27 • 4 • 1

Small models 8bpw EXL2 quants

8bpw EXL2 Quants of small models (usually 7-8B)

DeusImperator/L3-8B-Stheno-v3.1_exl2_8bpw_rpcal_mk2

Text Generation • Updated May 21, 2024 • 1
DeusImperator/daybreak-kunoichi-2dpo-7b_exl2_8bpw

Text Generation • Updated May 29, 2024 • 2
DeusImperator/L3-8B-Stheno-v3.2_exl2_8.04bpw

Text Generation • Updated Jun 6, 2024 • 2 • 1
DeusImperator/L3-8B-Stheno-v3.2_exl2_8.04bpw_rpcal_mk2

Text Generation • Updated Jun 6, 2024 • 1 • 1

Exl2 8bpw MAX quants

8 BPW exl2 quants using modified quantization script to force using best quantization method for each layer for max quality

DeusImperator/Lyra4-Gutenberg-12B_exl2_8bpw_max

Text Generation • Updated Sep 12, 2024 • 1
DeusImperator/Lyra4-Gutenberg-12B_exl2_8bpw_max_rpcal_mk2

Text Generation • Updated Sep 12, 2024 • 3
DeusImperator/Nemomix-v4.0-12B_exl2_8bpw_max

Text Generation • Updated Aug 1, 2024 • 1
DeusImperator/MN-12B-Lyra-v1_exl2_8bpw_max

Updated Aug 6, 2024 • 2

EXL2 70B for 24GB VRAM

70B LLMs that fit in 24GB VRAM with over 16k context (with exl2 Q4 cache)

DeusImperator/Midnight-Miqu-70B-v1.5_exl2_2.4bpw_rpcal

Text Generation • Updated May 19, 2024 • 1 • 2
DeusImperator/Midnight-Miqu-70B-v1.5_exl2_2.4bpw_rpcal_mk2

Text Generation • Updated May 19, 2024
DeusImperator/Midnight-Miqu-70B-v1.5_exl2_2.4bpw

Text Generation • Updated May 19, 2024
DeusImperator/Dark-Miqu-70B_exl2_2.4bpw

Text Generation • Updated May 24, 2024

Mid-range models exl2 quants

Exl2 quants of mid-range (20-40B) LLM models. Usually around 4-5 BPW

DeusImperator/magnum-v3-34b_exl2_4.6bpw

Updated Aug 27, 2024
DeusImperator/magnum-v3-34b_exl2_4.6bpw_rpcal_mk2

Updated Aug 30, 2024
DeusImperator/magnum-32b-v2_exl2_4.7bpw_rpcal_mk2

Text Generation • Updated Aug 27, 2024
DeusImperator/magnum-32b-v2_exl2_4.7bpw

Text Generation • Updated Aug 27, 2024

EXL3 models for 32GB VRAM

LLMs in EXL3 format that fit into 32GB VRAM

DeusImperator/Legion-V2.1-LLaMa-70B_exl3_3.0bpw_H6

Text Generation • 14B • Updated May 28 • 5
DeusImperator/L3.3-MS-Nevoria-70b_exl3_3.0bpw_H6

Text Generation • 14B • Updated Jun 1 • 2
DeusImperator/L3.3-GeneticLemonade-Unleashed-v3-70B_exl3_3.0bpw_H6

Text Generation • 14B • Updated Jun 9 • 6
DeusImperator/Strawberrylemonade-70B-v1.2_exl3_3.0bpw_H6

Text Generation • 14B • Updated Jun 27 • 4 • 1

EXL2 70B for 24GB VRAM

70B LLMs that fit in 24GB VRAM with over 16k context (with exl2 Q4 cache)

DeusImperator/Midnight-Miqu-70B-v1.5_exl2_2.4bpw_rpcal

Text Generation • Updated May 19, 2024 • 1 • 2
DeusImperator/Midnight-Miqu-70B-v1.5_exl2_2.4bpw_rpcal_mk2

Text Generation • Updated May 19, 2024
DeusImperator/Midnight-Miqu-70B-v1.5_exl2_2.4bpw

Text Generation • Updated May 19, 2024
DeusImperator/Dark-Miqu-70B_exl2_2.4bpw

Text Generation • Updated May 24, 2024

Small models 8bpw EXL2 quants

8bpw EXL2 Quants of small models (usually 7-8B)

DeusImperator/L3-8B-Stheno-v3.1_exl2_8bpw_rpcal_mk2

Text Generation • Updated May 21, 2024 • 1
DeusImperator/daybreak-kunoichi-2dpo-7b_exl2_8bpw

Text Generation • Updated May 29, 2024 • 2
DeusImperator/L3-8B-Stheno-v3.2_exl2_8.04bpw

Text Generation • Updated Jun 6, 2024 • 2 • 1
DeusImperator/L3-8B-Stheno-v3.2_exl2_8.04bpw_rpcal_mk2

Text Generation • Updated Jun 6, 2024 • 1 • 1

Mid-range models exl2 quants

Exl2 quants of mid-range (20-40B) LLM models. Usually around 4-5 BPW

DeusImperator/magnum-v3-34b_exl2_4.6bpw

Updated Aug 27, 2024
DeusImperator/magnum-v3-34b_exl2_4.6bpw_rpcal_mk2

Updated Aug 30, 2024
DeusImperator/magnum-32b-v2_exl2_4.7bpw_rpcal_mk2

Text Generation • Updated Aug 27, 2024
DeusImperator/magnum-32b-v2_exl2_4.7bpw

Text Generation • Updated Aug 27, 2024

Exl2 8bpw MAX quants

8 BPW exl2 quants using modified quantization script to force using best quantization method for each layer for max quality

DeusImperator/Lyra4-Gutenberg-12B_exl2_8bpw_max

Text Generation • Updated Sep 12, 2024 • 1
DeusImperator/Lyra4-Gutenberg-12B_exl2_8bpw_max_rpcal_mk2

Text Generation • Updated Sep 12, 2024 • 3
DeusImperator/Nemomix-v4.0-12B_exl2_8bpw_max

Text Generation • Updated Aug 1, 2024 • 1
DeusImperator/MN-12B-Lyra-v1_exl2_8bpw_max

Updated Aug 6, 2024 • 2

Company

TOS Privacy About Jobs

Website

Models Datasets Spaces Pricing Docs