TheBlokes Base Llama 2 GPTQ's - a lallesx Collection

lallesx 's Collections

TheBlokes Base Llama 2 GGML's

TheBlokes Base Llama 2 GGUF's

TheBlokes Base Llama 2 GPTQ's

TheBlokes Base Llama quants

TheBlokes Base Llama 2 GPTQ's

updated Sep 10, 2023

His base GPTQ quants for Llama 2 & CodeLlama

TheBloke/Llama-2-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 23k • 81
TheBloke/Llama-2-7B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 17.5k • 263
TheBloke/Llama-2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 786 • 120
TheBloke/Llama-2-13B-chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 17.2k • 362
TheBloke/Llama-2-70B-GPTQ

Text Generation • Updated Sep 27, 2023 • 2.17k • 83
TheBloke/Llama-2-70B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 6.41k • 261
TheBloke/CodeLlama-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 324 • 14
TheBloke/CodeLlama-7B-Instruct-GPTQ

Text Generation • Updated Sep 27, 2023 • 589 • 46
TheBloke/CodeLlama-7B-Python-GPTQ

Text Generation • Updated Sep 27, 2023 • 164 • 23
TheBloke/CodeLlama-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 105 • 11
TheBloke/CodeLlama-13B-Instruct-GPTQ

Text Generation • Updated Sep 27, 2023 • 628 • 39
TheBloke/CodeLlama-13B-Python-GPTQ

Text Generation • Updated Sep 27, 2023 • 155 • 20
TheBloke/CodeLlama-34B-GPTQ

Text Generation • Updated Sep 27, 2023 • 121 • 20
TheBloke/CodeLlama-34B-Instruct-GPTQ

Text Generation • Updated Sep 27, 2023 • 555 • 74
TheBloke/CodeLlama-34B-Python-GPTQ

Text Generation • Updated Sep 27, 2023 • 85 • 14