Edit Models filters

Apps

Docker Model Runner

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

9,070

Full-text search

Active filters: pruna-ai

PrunaAI/openchat-openchat-3.6-8b-20240522-bnb-4bit-smashed

Text Generation • 5B • Updated Jul 17, 2024 • 3

PrunaAI/openchat-openchat-3.6-8b-20240522-bnb-8bit-smashed

Text Generation • 8B • Updated Jul 17, 2024 • 2

PrunaAI/openchat-openchat-3.6-8b-20240522-HQQ-1bit-smashed

Text Generation • Updated Jul 17, 2024 • 2

PrunaAI/openchat-openchat-3.6-8b-20240522-HQQ-2bit-smashed

Text Generation • Updated Jul 17, 2024 • 2

PrunaAI/openchat-openchat-3.6-8b-20240522-HQQ-4bit-smashed

Text Generation • Updated Jul 17, 2024 • 2

PrunaAI/openchat-openchat-3.6-8b-20240522-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 2

PrunaAI/openchat-openchat-3.6-8b-20240522-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 17, 2024 • 2

PrunaAI/openchat-openchat-3.6-8b-20240522-QUANTO-float8bit-smashed

Updated Jul 19, 2024 • 2

PrunaAI/openchat-openchat-3.6-8b-20240522-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 3

PrunaAI/openlynn-Llama-3-Soliloquy-8B-v1-bnb-4bit-smashed

Text Generation • 5B • Updated Jul 17, 2024 • 2

PrunaAI/openlynn-Llama-3-Soliloquy-8B-v1-bnb-8bit-smashed

Text Generation • 8B • Updated Jul 17, 2024 • 2

PrunaAI/openlynn-Llama-3-Soliloquy-8B-v1-HQQ-1bit-smashed

Text Generation • Updated Jul 17, 2024 • 2

PrunaAI/openlynn-Llama-3-Soliloquy-8B-v1-HQQ-2bit-smashed

Text Generation • Updated Jul 17, 2024 • 1

PrunaAI/openlynn-Llama-3-Soliloquy-8B-v1-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 1

PrunaAI/openlynn-Llama-3-Soliloquy-8B-v1-QUANTO-float8bit-smashed

Updated Jul 19, 2024 • 2

PrunaAI/openlynn-Llama-3-Soliloquy-8B-v1-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 2

PrunaAI/openlynn-Llama-3-Soliloquy-8B-v1-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 17, 2024 • 2

PrunaAI/bigcode-starcoder2-7b-HQQ-1bit-smashed

Text Generation • Updated Jul 17, 2024 • 2

PrunaAI/bigcode-starcoder2-7b-bnb-4bit-smashed

Text Generation • 4B • Updated Jul 17, 2024 • 4

PrunaAI/bigcode-starcoder2-7b-bnb-8bit-smashed

Text Generation • 7B • Updated Jul 17, 2024 • 4

PrunaAI/bigcode-starcoder2-7b-QUANTO-int2bit-smashed

Updated Jul 19, 2024 • 1

PrunaAI/bigcode-starcoder2-7b-QUANTO-float8bit-smashed

Updated Jul 19, 2024 • 3

PrunaAI/bigcode-starcoder2-7b-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 2

PrunaAI/bigcode-starcoder2-7b-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 3

PrunaAI/numind-NuExtract-tiny-HQQ-1bit-smashed

Text Generation • Updated Jul 17, 2024 • 2

PrunaAI/numind-NuExtract-tiny-bnb-4bit-smashed

Text Generation • 0.3B • Updated Jul 17, 2024 • 2

PrunaAI/numind-NuExtract-tiny-HQQ-4bit-smashed

Text Generation • Updated Jul 17, 2024 • 2

PrunaAI/numind-NuExtract-tiny-HQQ-2bit-smashed

Text Generation • Updated Jul 17, 2024 • 5

PrunaAI/numind-NuExtract-tiny-QUANTO-int2bit-smashed

Updated Jul 19, 2024 • 2

PrunaAI/numind-NuExtract-tiny-AWQ-4bit-smashed

Text Generation • 0.4B • Updated Jul 17, 2024 • 2