Edit Models filters

Apps

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

3

Full-text search

Active filters: 6.0-bpw

alokabhishek/Meta-Llama-3-8B-Instruct-6.0-bpw-exl2

Text Generation • Updated Apr 26, 2024 • 15 • 1

alokabhishek/Mistral-7B-Instruct-v0.2-6.0-bpw-exl2

Text Generation • Updated May 9, 2024 • 16 • 2

alokabhishek/Llama-2-7b-chat-hf-6.0-bpw-exl2

Text Generation • Updated May 9, 2024 • 22 • 1