Quantized Models - a teknium Collection

teknium 's Collections

Quantized Models

Quantized Models

updated Nov 3, 2023

TheBloke/OpenHermes-2.5-Mistral-7B-GGUF

7B • Updated Nov 2, 2023 • 36.4k • 256
TheBloke/OpenHermes-2.5-Mistral-7B-GPTQ

Text Generation • 1B • Updated Nov 2, 2023 • 835 • 28
TheBloke/OpenHermes-2.5-Mistral-7B-AWQ

Text Generation • 1B • Updated Nov 9, 2023 • 4.16k • 21
bartowski/OpenHermes-2.5-Mistral-7B-exl2

Updated Nov 2, 2023 • 6 • 11