HF Quantization

community

AI & ML interests

Making AI models smaller, and faster with Quantization

Recent Activity

medmekk updated a Space 6 days ago

HF-Quantization/bnb-my-repo

medmekk new activity 7 days ago

HF-Quantization/bnb-my-repo:Apply for community grant: Company project (gpu)

medmekk updated a Space 7 days ago

HF-Quantization/bnb-my-repo

View all activity

Collections 1

spaces 3

BitsAndBytes

Quantize and save models to Hugging Face

TorchAO

Quantize Hugging Face models and save to your profile

TorchAO

Quantize and save Hugging Face models

models 11

HF-Quantization/Llama-3.3-70B-Instruct-TORCHAO-W8

HF-Quantization/Llama-3.3-70B-Instruct-TORCHAO-W4

Updated Jan 22 • 8

HF-Quantization/Llama-3.2-1B-BNB-INT8

Updated Jan 21 • 22

HF-Quantization/Llama-3.2-1B-BNB-NF4

Updated Jan 21 • 27

HF-Quantization/Llama-3.2-1B-BNB-FP4

Updated Jan 21 • 66

HF-Quantization/Llama-3.2-1B-BNB-NF4-BF16

Updated Jan 21 • 16

HF-Quantization/Llama-3.2-1B-BNB-FP4-BF16

Updated Jan 21 • 20

HF-Quantization/Llama-3.2-1B-TORCHAO-W8A8

Updated Jan 21 • 9

HF-Quantization/Llama-3.2-1B-TORCHAO-W8

Updated Jan 21 • 15

HF-Quantization/Llama-3.2-1B-TORCHAO-W4

Updated Jan 21 • 12

datasets

None public yet