Quantizations (4-bit) - a parasail-ai Collection

parasail-ai 's Collections

TinyLlama3-1.58B

MicroLlama3-464M

NanoLlama3-157M

Quantizations (4-bit)

Quantizations (4-bit)

updated Jul 15, 2024

parasail-ai/Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation • Updated Jul 13, 2024 • 5 • 1
parasail-ai/aya-23-8B-GPTQ-4bit

Text Generation • Updated Jul 15, 2024 • 4 • 2