Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

108

Full-text search

Active filters: float16

OpenNMT/Llama-2-7b-chat-hf-ct2-int8

Text Generation • Updated Dec 1, 2023 • 6

avans06/ALMA-7B-ct2-int8_float16

Text Generation • Updated Dec 15, 2023 • 2

avans06/ALMA-13B-ct2-int8_float16

Text Generation • Updated Dec 15, 2023 • 1

avans06/Meta-Llama-3-8B-Instruct-ct2-int8_float16

Text Generation • Updated Apr 25, 2024 • 8

nitsuai/ct2fast-all-MiniLM-L6-v2

Sentence Similarity • Updated Apr 26, 2024

nitsuai/ct2fast-paraphrase-multilingual-MiniLM-L12-v2

Sentence Similarity • Updated Apr 26, 2024 • 1

Weblet/Llama-2-7b-chat-hf-ct2-int8

Text Generation • Updated Apr 30, 2024 • 6

DavidAU/Estopia-Grande-20B-Instruct-Ultra-GGUF

Text Generation • 21B • Updated Nov 14, 2024 • 483 • 1

avans06/Meta-Llama-3.1-8B-Instruct-ct2-int8_float16

Text Generation • Updated Oct 10, 2024 • 9

avans06/Meta-Llama-3.2-8B-Instruct-ct2-int8_float16

Text Generation • Updated Oct 13, 2024 • 18

DavidAU/How-To-Use-Reasoning-Thinking-Models-and-Create-Them

Text Generation • Updated Jul 27 • 9

DavidAU/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506

Text Generation • 46B • Updated Jun 29 • 5 • 5

Merlinoz11/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506-Q6_K-GGUF

Text Generation • 45B • Updated Jun 25 • 24 • 1

mradermacher/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506-GGUF

45B • Updated Aug 1 • 179 • 1

Merlinoz11/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506-Q5_K_M-GGUF

Text Generation • 45B • Updated Jun 25 • 8

wesjos/spark-tts-genshin-charactors

Text-to-Speech • Updated Jul 21 • 2

mradermacher/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506-i1-GGUF

45B • Updated Jul 11 • 420

DavidAU/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506-GGUF

Text Generation • 45B • Updated Jun 29 • 510