Edit Models filters

Inference status

Misc

Inference Endpoints

4-bit precision

8-bit precision

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

2,588

Full-text search

Active filters: GGUF

andrijdavid/CatPPT-base-GGUF

Text Generation • Updated Dec 27, 2023 • 179 • 1

andrijdavid/LMCocktail-10.7B-v1-GGUF

Text Generation • Updated Dec 27, 2023 • 54 • 1

andrijdavid/Sakura-SOLAR-Instruct-GGUF

Text Generation • Updated Dec 28, 2023 • 68 • 1

tsunemoto/TinyLlama-1.1B-Chat-v0.6-x8-MoE-GGUF

Updated Dec 29, 2023 • 228 • 6

Mozilla/TinyLlama-1.1B-Chat-v1.0-llamafile

Updated 17 days ago • 5.97k • 14

andrijdavid/CarbonVillain-en-10.7B-v2-GGUF

Text Generation • Updated Jan 1 • 17

andrijdavid/StopCarbon-10.7B-v5-GGUF

Text Generation • Updated Jan 1 • 69 • 1

LiteLLMs/CarbonVillain-en-10.7B-v3-GGUF

Text Generation • Updated Jan 1 • 29

yargpt/vicuna-13b-v1.5-gguf

Text Generation • Updated Jan 2 • 1 • 1

andrijdavid/TinyLlama-1.1B-Chat-v1.0-GGUF

Text Generation • Updated Jan 19 • 271 • 1

andrijdavid/finance-chat-GGUF

Text Generation • Updated Jan 19 • 218 • 1

andrijdavid/TinyLlama-1.1B-32k-GGUF

Text Generation • Updated Jan 2 • 46

andrijdavid/MobileLLaMA-1.4B-Base-GGUF

Text Generation • Updated Jan 2 • 221 • 1

andrijdavid/tinyfrank-1.4B-GGUF

Text Generation • Updated Jan 2 • 42

andrijdavid/MiniMA-2-3B-GGUF

Text Generation • Updated Jan 2 • 122

Trelis/Tiny

Text Generation • Updated Feb 22 • 7

tsunemoto/FlatDolphinMaid-8x7B-GGUF

Updated Jan 4 • 77

rabil/TinyLlama-1.1B-Chat-v1.0-llamafile

Updated Jan 4 • 104

tsunemoto/Norobara-ZLoss-8x7B-GGUF

Updated Jan 5 • 19

rabil/deepseek-coder-6.7b-instruct-llamafile

Updated Jan 5 • 21 • 2

rabil/dolphin-2_6-phi-2-llamafile

Updated Jan 7 • 88

tsunemoto/LiteLlama-460M-1T-GGUF

Updated Jan 7 • 113 • 6

rabil/openchat-3.5-0106-llamafile

Updated Jan 11 • 59

tuantran1632001/Psyfighter2-Orca2-13B-ties-GGUF

Updated Jan 12 • 620

sethuiyer/MedleyMD-GGUF

Updated Jan 15 • 8 • 1

tsunemoto/NexoNimbus-7B-GGUF

Updated Jan 15 • 74 • 1

tsunemoto/Heimer-kto-TinyLlama-1.1B-GGUF

Updated Jan 15 • 119

tsunemoto/Heimer-ipo-TinyLlama-1.1B-GGUF

Updated Jan 15 • 74

tsunemoto/Heimer-dpo-TinyLlama-1.1B-GGUF

Updated Jan 15 • 84

vicgalle/solarized-18B-dpo-GGUF

Updated Jan 20 • 55 • 3