senfu/Llama-3.1-8B-Instruct-CommVQ-2bit
9B
•
Updated
•
7
CommVQ
CommVQ: Commutative Vector Quantization for KV Cache Compression
CommVQ: Commutative Vector Quantization for KV Cache Compression