llmcompressor-quants

llmcompressor-quants 's models 2

Sort:  Recently updated

llmcompressor-quants/Qwen2.5-7B-Instruct-fp8-dynamic

Text Generation • 8B • Updated May 26 • 6

llmcompressor-quants/Mistral-Small-Instruct-2409-fp8-dynamic

22B • Updated Sep 21, 2024 • 2