Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

arxiv: 2310.04799

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

76

Full-text search

Active filters: 2310.04799

mav23/gemma-2-baku-2b-it-GGUF

Text Generation • Updated Oct 7, 2024 • 75

RichardErkhov/rinna_-_gemma-2-baku-2b-it-4bits

Updated Oct 18, 2024 • 4

RichardErkhov/rinna_-_gemma-2-baku-2b-it-8bits

Updated Oct 18, 2024 • 6

RioShiina/gemma-2-baku-2b-it-exl2

Updated Jan 3 • 3

RioShiina/llama-3-youko-70b-instruct-exl2

Text Generation • Updated Jan 3 • 11

mav23/Llama-3-Open-Ko-8B-GGUF

Text Generation • Updated Nov 11, 2024 • 54

mav23/llama-3-youko-8b-instruct-GGUF

Updated Nov 12, 2024 • 286

ryota39/Tora-12B

Text Generation • Updated Nov 25, 2024 • 15 • 1

RichardErkhov/rinna_-_gemma-2-baku-2b-it-awq

Updated Nov 28, 2024 • 5

rinna/deepseek-r1-distill-qwen2.5-bakeneko-32b-gptq-int4

Text Generation • Updated 29 days ago • 188

rinna/deepseek-r1-distill-qwen2.5-bakeneko-32b-gptq-int8

Text Generation • Updated 29 days ago • 222

rinna/qwen2.5-bakeneko-32b-instruct-awq

Text Generation • Updated 28 days ago • 329

rinna/qwen2.5-bakeneko-32b-instruct-gptq-int4

Text Generation • Updated 28 days ago • 296

rinna/qwq-bakeneko-32b-awq

Text Generation • Updated 1 day ago • 32

rinna/qwq-bakeneko-32b-gptq-int8

Text Generation • Updated 1 day ago • 7

rinna/qwq-bakeneko-32b-gptq-int4

Text Generation • Updated 1 day ago • 53