AQLM+PV

ISTA-DASLab 's Collections

AQLM

updated 12 days ago

Official AQLM quantizations for "PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression": https://arxiv.org/abs/2405.14852

Upvote

PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression

Paper • 2405.14852 • Published May 23, 2024 • 2
ISTA-DASLab/Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16

Text Generation • Updated Sep 17, 2024 • 77 • 46
ISTA-DASLab/Mistral-Nemo-Instruct-2407-AQLM-PV-2Bit-1x16-hf

Updated Aug 16, 2024 • 14 • 3
ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-2Bit-1x16-hf

Text Generation • Updated Aug 28, 2024 • 39 • 8
ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-2Bit-2x8-hf

Text Generation • Updated Aug 9, 2024 • 85 • 2
ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-1Bit-1x16-hf

Text Generation • Updated Aug 9, 2024 • 74
ISTA-DASLab/Meta-Llama-3.1-8B-AQLM-PV-2Bit-1x16-hf

Text Generation • Updated Aug 9, 2024 • 85 • 3
ISTA-DASLab/Meta-Llama-3.1-8B-AQLM-PV-1Bit-1x16-hf

Text Generation • Updated Aug 9, 2024 • 90
ISTA-DASLab/Qwen2-72B-Instruct-AQLM-PV-2bit-1x16

Text Generation • Updated Jul 25, 2024 • 16 • 1
ISTA-DASLab/Qwen2-72B-Instruct-AQLM-PV-1bit-1x16

Text Generation • Updated Jul 25, 2024 • 86 • 1
ISTA-DASLab/Qwen2-72B-AQLM-PV-2bit-1x16

Text Generation • Updated Jul 25, 2024 • 16
ISTA-DASLab/Qwen2-72B-AQLM-PV-1bit-1x16

Text Generation • Updated Jul 25, 2024 • 14
ISTA-DASLab/Phi-3-medium-4k-instruct-AQLM-PV-1Bit-1x16-hf

Text Generation • Updated Jul 8, 2024 • 90
ISTA-DASLab/Meta-Llama-3-70B-AQLM-PV-2Bit-1x16

Text Generation • Updated May 31, 2024 • 29 • 4
ISTA-DASLab/Meta-Llama-3-8B-AQLM-PV-2Bit-1x16

Text Generation • Updated May 31, 2024 • 436 • 3
ISTA-DASLab/Llama-2-7b-AQLM-PV-2Bit-2x8-hf

Text Generation • Updated May 31, 2024 • 98
ISTA-DASLab/Phi-3-mini-4k-instruct-AQLM-PV-2Bit-1x16-hf

Text Generation • Updated Aug 3, 2024 • 28 • 1
ISTA-DASLab/Mistral-7B-v0.1-AQLM-PV-2Bit-1x16-hf

Text Generation • Updated May 30, 2024 • 14
ISTA-DASLab/Llama-2-70b-AQLM-PV-2Bit-1x16-hf

Text Generation • Updated May 31, 2024 • 12
ISTA-DASLab/Llama-2-13b-AQLM-PV-2Bit-1x16-hf

Text Generation • Updated May 31, 2024 • 17
ISTA-DASLab/Llama-2-7b-AQLM-PV-2Bit-1x16-hf

Text Generation • Updated May 31, 2024 • 21
ISTA-DASLab/Llama-2-7b-AQLM-PV-1Bit-1x16-hf

Text Generation • Updated May 31, 2024 • 167
ISTA-DASLab/Llama-3.2-1B-AQLM-PV-2Bit-2x8

Text Generation • Updated Nov 8, 2024 • 381
ISTA-DASLab/Llama-3.2-1B-Instruct-AQLM-PV-2Bit-2x8

Text Generation • Updated Nov 8, 2024 • 39
ISTA-DASLab/Llama-3.2-3B-AQLM-PV-2Bit-2x8

Text Generation • Updated Nov 8, 2024 • 838
ISTA-DASLab/Llama-3.2-3B-Instruct-AQLM-PV-2Bit-2x8

Text Generation • Updated Nov 8, 2024 • 16

Upvote