Article
17 Reasons Why Gradio Isn't Just Another UI Library
•
23
Jared Sulzdorf PRO
jsulz
AI & ML interests
Infrastructure, law, policy
Recent Activity
reacted
to
danielhanchen's
post
with 🚀
1 day ago
🦥 Introducing Unsloth Dynamic v2.0 GGUFs!
Our v2.0 quants set new benchmarks on 5-shot MMLU and KL Divergence, meaning you can now run & fine-tune quantized LLMs while preserving as much accuracy as possible.
Llama 4: https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF
DeepSeek-R1: https://huggingface.co/unsloth/DeepSeek-R1-GGUF-UD
Gemma 3: https://huggingface.co/unsloth/gemma-3-27b-it-GGUF
We made selective layer quantization much smarter. Instead of modifying only a subset of layers, we now dynamically quantize all layers so every layer has a different bit. Now, our dynamic method can be applied to all LLM architectures, not just MoE's.
Blog with Details: https://docs.unsloth.ai/basics/dynamic-v2.0
All our future GGUF uploads will leverage Dynamic 2.0 and our hand curated 300K–1.5M token calibration dataset to improve conversational chat performance.
For accurate benchmarking, we built an evaluation framework to match the reported 5-shot MMLU scores of Llama 4 and Gemma 3. This allowed apples-to-apples comparisons between full-precision vs. Dynamic v2.0, QAT and standard iMatrix quants.
Dynamic v2.0 aims to minimize the performance gap between full-precision models and their quantized counterparts.
reacted
to
danielhanchen's
post
with ❤️
1 day ago
🦥 Introducing Unsloth Dynamic v2.0 GGUFs!
Our v2.0 quants set new benchmarks on 5-shot MMLU and KL Divergence, meaning you can now run & fine-tune quantized LLMs while preserving as much accuracy as possible.
Llama 4: https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF
DeepSeek-R1: https://huggingface.co/unsloth/DeepSeek-R1-GGUF-UD
Gemma 3: https://huggingface.co/unsloth/gemma-3-27b-it-GGUF
We made selective layer quantization much smarter. Instead of modifying only a subset of layers, we now dynamically quantize all layers so every layer has a different bit. Now, our dynamic method can be applied to all LLM architectures, not just MoE's.
Blog with Details: https://docs.unsloth.ai/basics/dynamic-v2.0
All our future GGUF uploads will leverage Dynamic 2.0 and our hand curated 300K–1.5M token calibration dataset to improve conversational chat performance.
For accurate benchmarking, we built an evaluation framework to match the reported 5-shot MMLU scores of Llama 4 and Gemma 3. This allowed apples-to-apples comparisons between full-precision vs. Dynamic v2.0, QAT and standard iMatrix quants.
Dynamic v2.0 aims to minimize the performance gap between full-precision models and their quantized counterparts.
reacted
to
danielhanchen's
post
with 🤗
1 day ago
🦥 Introducing Unsloth Dynamic v2.0 GGUFs!
Our v2.0 quants set new benchmarks on 5-shot MMLU and KL Divergence, meaning you can now run & fine-tune quantized LLMs while preserving as much accuracy as possible.
Llama 4: https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF
DeepSeek-R1: https://huggingface.co/unsloth/DeepSeek-R1-GGUF-UD
Gemma 3: https://huggingface.co/unsloth/gemma-3-27b-it-GGUF
We made selective layer quantization much smarter. Instead of modifying only a subset of layers, we now dynamically quantize all layers so every layer has a different bit. Now, our dynamic method can be applied to all LLM architectures, not just MoE's.
Blog with Details: https://docs.unsloth.ai/basics/dynamic-v2.0
All our future GGUF uploads will leverage Dynamic 2.0 and our hand curated 300K–1.5M token calibration dataset to improve conversational chat performance.
For accurate benchmarking, we built an evaluation framework to match the reported 5-shot MMLU scores of Llama 4 and Gemma 3. This allowed apples-to-apples comparisons between full-precision vs. Dynamic v2.0, QAT and standard iMatrix quants.
Dynamic v2.0 aims to minimize the performance gap between full-precision models and their quantized counterparts.
Organizations
jsulz's activity
upvoted
an
article
1 day ago
upvoted
a
collection
3 days ago
upvoted
a
collection
4 days ago
upvoted
an
article
7 days ago
Article
Introduction to ggml
•
187
upvoted
a
paper
10 days ago
upvoted
an
article
10 days ago
Article
Cohere on Hugging Face Inference Providers 🔥
•
123
upvoted
a
collection
20 days ago
upvoted
a
paper
20 days ago
upvoted
an
article
21 days ago
Article
Welcome Llama 4 Maverick & Scout on Hugging Face!
•
141
upvoted
an
article
about 1 month ago
Article
Training and Finetuning Reranker Models with Sentence Transformers v4
•
120
upvoted
a
paper
about 1 month ago
upvoted
a
collection
about 1 month ago
upvoted
an
article
about 1 month ago
Article
The New and Fresh analytics in Inference Endpoints
•
19
upvoted
2
collections
about 1 month ago
upvoted
2
articles
about 1 month ago
Article
AI Policy: 🤗 Response to the White House AI Action Plan RFI
•
26
Article
Xet is on the Hub
•
47