Edit Models filters

Model Tree

TheDrummer/Anubis-70B-v1

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

20

Full-text search

Active filters: TheDrummer/Anubis-70B-v1

bartowski/Anubis-70B-v1-GGUF

Text Generation • Updated Dec 22, 2024 • 7.62k • 9

mradermacher/Anubis-70B-v1-GGUF

Updated Dec 22, 2024 • 119 • 1

mradermacher/Anubis-70B-v1-i1-GGUF

Updated Dec 22, 2024 • 624

Jellon/Anubis-70B-v1-exl2-3bpw

Updated Dec 24, 2024 • 9

Dracones/Anubis-70B-v1_exl2_8.0bpw

Text Generation • Updated Dec 25, 2024 • 55 • 1

Dracones/Anubis-70B-v1_exl2_7.0bpw

Text Generation • Updated Dec 25, 2024 • 7

Dracones/Anubis-70B-v1_exl2_6.0bpw

Text Generation • Updated Dec 25, 2024 • 13

Dracones/Anubis-70B-v1_exl2_5.0bpw

Text Generation • Updated Dec 25, 2024 • 9

Dracones/Anubis-70B-v1_exl2_4.5bpw

Text Generation • Updated Dec 25, 2024 • 25

Dracones/Anubis-70B-v1_exl2_4.0bpw

Text Generation • Updated Dec 25, 2024 • 13

Dracones/Anubis-70B-v1_exl2_3.5bpw

Text Generation • Updated Dec 25, 2024 • 20

Dracones/Anubis-70B-v1_exl2_3.0bpw

Text Generation • Updated Dec 25, 2024 • 5

Dracones/Anubis-70B-v1_exl2_2.75bpw

Text Generation • Updated Dec 25, 2024 • 2

Dracones/Anubis-70B-v1_exl2_2.5bpw

Text Generation • Updated Dec 25, 2024 • 6

Dracones/Anubis-70B-v1_exl2_2.25bpw

Text Generation • Updated Dec 25, 2024 • 11

backyardai/Anubis-70B-v1-GGUF

Updated Dec 29, 2024 • 748

beezu/Anubis-70B-v1-MLX-8Bit

Updated 3 days ago • 5

beezu/Anubis-70B-v1-MLX-6Bit

Updated 3 days ago

beezu/Anubis-70B-v1-MLX-4Bit

Updated 3 days ago • 5

beezu/Anubis-70B-v1-MLX-3Bit

Updated 3 days ago