SINQ Collection This collection contains the models quantized with the SINQ quantization method. • 12 items • Updated 5 days ago • 10
AcceLLM: Accelerating LLM Inference using Redundancy for Load Balancing and Data Locality Paper • 2411.05555 • Published Nov 8, 2024 • 6
SINQ: Sinkhorn-Normalized Quantization for Calibration-Free Low-Precision LLM Weights Paper • 2509.22944 • Published 28 days ago • 76