Edit Models filters

Inference status

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

5,923

Full-text search

Active filters: 8-bit

HF1BitLLM/Llama3-8B-1.58-Linear-10B-tokens

Text Generation • Updated Sep 18 • 789 • 9

HF1BitLLM/Llama3-8B-1.58-Sigmoid-k100-10B-tokens

Text Generation • Updated Sep 18 • 61 • 11

MaziyarPanahi/solar-pro-preview-instruct-GGUF

Text Generation • Updated Sep 13 • 1.72M • 18

Qwen/Qwen2-VL-72B-Instruct-GPTQ-Int8

Image-Text-to-Text • Updated Sep 24 • 3.21k • 6

Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 1.8k • 5

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 4.11k • 11

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 15.5k • 8

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 6.96k • 7

brunopio/Llama3-8B-1.58-100B-tokens-GGUF

Text Generation • Updated Sep 19 • 1.58M • 9

Qwen/Qwen2.5-Coder-7B-Instruct-GPTQ-Int8

Text Generation • Updated 6 days ago • 1.14k • 2

CalamitousFelicitousness/Qwen2-VL-72B-Instruct-GPTQ-Int8-tpfix

Image-Text-to-Text • Updated Sep 22 • 14 • 1

velvetScar/llm2vec-llama-3.1-8B

Sentence Similarity • Updated Sep 23 • 11 • 1

MaziyarPanahi/Llama-3.2-1B-Instruct-GGUF

Text Generation • Updated Sep 25 • 1.74M • 4

neuralmagic/Llama-3.2-1B-Instruct-quantized.w8a8

Text Generation • Updated Oct 16 • 2.04k • 3

Statuo/MS-Cydonian-Gutenberg-22b-8bpw

Text Generation • Updated Sep 26 • 9 • 2

MikeRoz/ArliAI_Mistral-Small-22B-ArliAI-RPMax-v1.1-8.0bpw-h8-exl2

Updated Sep 26 • 55 • 1

adriabama06/Llama-3.2-1B-Instruct-GPTQ-8bit-128g

Text Generation • Updated Sep 28 • 384 • 1

sunilrufus/Mistral_Instruct_Nemo_12B_quantized_w8a8

Text Generation • Updated Sep 30 • 399 • 1

qeternity/Qwen2.5-72B-Instruct-W8A8

Updated Oct 1 • 11 • 1

NeoChen1024/aya-23-8B-exl2-8.0bpw-h8

Text Generation • Updated Oct 2 • 14 • 1

Handgun1773/Qwen2.5-Coder-7B-BASE-8.0bpw-exl2

Text Generation • Updated Oct 4 • 14 • 1

mlx-community/Dracarys2-72B-Instruct-8bit

Text Generation • Updated Oct 6 • 22 • 1

altomek/gemma-2-9b-8bpw-EXL2

Text Generation • Updated Oct 7 • 12 • 1

mlx-community/Llama-3.1-Swallow-8B-Instruct-v0.1-8bit

Text Generation • Updated Oct 8 • 43 • 1

noneUsername/SuperNova-Medius-W8A8-Dynamic-Per-Token

Updated 30 days ago • 675 • 1

bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-8.0bpw-8hb-exl2

Text Generation • Updated Oct 16 • 160 • 3

mlx-community/Ministral-8B-Instruct-2410-8bit

Updated Oct 17 • 138 • 1

mlx-community/Llama-3.1-Nemotron-70B-Instruct-HF-8bit

Text Generation • Updated Oct 17 • 6.36k • 1

MaziyarPanahi/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF

Text Generation • Updated about 1 month ago • 1.54k • 3

luigi86/magnum-v3-34b_mlx-8bpw

Text Generation • Updated Oct 17 • 8 • 1