Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

5,385

Full-text search

Active filters: exl2

KT313/Llama-3-8B-RAG-v1-exl2-6.0bpw

Text Generation • Updated Jul 29, 2024 • 7

Statuo/Celeste-12b-EXL2-8bpw

Text Generation • Updated Jul 29, 2024 • 4

Statuo/Celeste-12b-EXL2-6bpw

Text Generation • Updated Jul 29, 2024 • 4

Statuo/Celeste-12b-EXL2-4bpw

Text Generation • Updated Jul 29, 2024 • 4

BigHuggyD/NeverSleep_Lumimaid-v0.2-123B_exl2_5.0bpw_h8

Text Generation • Updated Jul 29, 2024 • 9 • 1

DeusImperator/Celeste-12B-V1.6_exl2_8bpw_max

Text Generation • Updated Jul 29, 2024 • 4 • 1

DeusImperator/Lumimaid-v0.2-12B_exl2_8bpw_max

Text Generation • Updated Jul 29, 2024 • 5

BigHuggyD/NeverSleep_Lumimaid-v0.2-123B_exl2_5.5bpw_h8

Text Generation • Updated Jul 29, 2024 • 7

altomek/Nemomix-v3.0-12B-8bpw-EXL2

Text Generation • Updated Aug 30, 2024 • 6 • 1

BigHuggyD/NeverSleep_Lumimaid-v0.2-123B_exl2_6.0bpw_h8

Text Generation • Updated Jul 29, 2024 • 6

BigHuggyD/NeverSleep_Lumimaid-v0.2-123B_exl2_6.5bpw_h8

Text Generation • Updated Jul 30, 2024 • 9

BigHuggyD/NeverSleep_Lumimaid-v0.2-123B_exl2_7.0bpw_h8

Text Generation • Updated Jul 30, 2024 • 6

BigHuggyD/NeverSleep_Lumimaid-v0.2-123B_exl2_7.5bpw_h8

Text Generation • Updated Jul 30, 2024 • 6

altomek/lumi-nemo-e2.0-12B-8bpw-EXL2

Text Generation • Updated Aug 30, 2024 • 5

BigHuggyD/NeverSleep_Lumimaid-v0.2-123B_exl2_8.0bpw_h8

Text Generation • Updated Jul 30, 2024 • 7

altomek/romulus-mistral-nemo-12b-simpo-8bpw-EXL2

Text Generation • Updated Aug 30, 2024 • 7

BigHuggyD/NeverSleep_Lumimaid-v0.2-123B_exl2_4.25bpw_h8

Text Generation • Updated Jul 30, 2024 • 7

lucyknada/NeverSleep_Lumimaid-v0.2-70B-exl2-4.0bpw

Text Generation • Updated Jul 31, 2024 • 18

tango67/Llama-3-70B-Instruct-exl2-5.0bpw

Text Generation • Updated Jul 31, 2024 • 11

bullerwins/gemma-2-2b-it-exl2_8.0bpw

Text Generation • Updated Jul 31, 2024 • 5

Statuo/Mistral-Nemo-Instruct-2407-EXL2-8bpw

Text Generation • Updated Aug 1, 2024 • 4

Statuo/Mistral-Nemo-Instruct-2407-EXL2-6bpw

Text Generation • Updated Aug 1, 2024 • 4

Statuo/Mistral-Nemo-Instruct-2407-EXL2-4bpw

Text Generation • Updated Aug 1, 2024 • 7

DeusImperator/Nemomix-v4.0-12B_exl2_8bpw_max

Text Generation • Updated Aug 1, 2024 • 5

DBMe/Tess-v2.5.2-Qwen2-72B-4.8bpw-h6-exl2-pippa

Updated Oct 21, 2024 • 6

grimjim/Mistral-Nemo-Base-2407-12B-6.4bpw-exl2

Text Generation • Updated Aug 25, 2024 • 5

dmanary-pronavigator/gemma-2-27b-it-exl2-6.0bpw

Text Generation • Updated Jul 7, 2024 • 12

dmanary-pronavigator/gemma-2-27b-it-exl2-5.0bpw

Text Generation • Updated Jul 7, 2024 • 3

dmanary-pronavigator/gemma-2-27b-it-exl2-4.5bpw

Text Generation • Updated Jul 7, 2024 • 6

ek826/Meta-Llama-3.1-405B-Instruct-6.0bpw-exl2

Text Generation • Updated Aug 4, 2024 • 8 • 2