Timon

KeyboardMasher

AI & ML interests

None yet

Recent Activity

reacted to fdaudens's post with 😎 2 days ago

Yes, DeepSeek R1's release is impressive. But the real story is what happened in just 7 days after: - Original release: 8 models, 540K downloads. Just the beginning... - The community turned those open-weight models into +550 NEW models on Hugging Face. Total downloads? 2.5M—nearly 5X the originals. The reason? DeepSeek models are open-weight, letting anyone build on top of them. Interesting to note that the community focused on quantized versions for better efficiency & accessibility. They want models that use less memory, run faster, and are more energy-efficient. When you empower builders, innovation explodes. For everyone. 🚀 The most popular community model? @bartowski's DeepSeek-R1-Distill-Qwen-32B-GGUF version — 1M downloads alone.

new activity 9 days ago

unsloth/DeepSeek-V3-GGUF:Issue with --n-gpu-layers 5 Parameter: Model Only Running on CPU

new activity 10 days ago

unsloth/DeepSeek-V3-GGUF:Advice on running llama-server with Q2_K_L quant

View all activity

Organizations

None yet

KeyboardMasher's activity

reacted to fdaudens's post with 😎 2 days ago

Post

7359

Yes, DeepSeek R1's release is impressive. But the real story is what happened in just 7 days after:

- Original release: 8 models, 540K downloads. Just the beginning...

- The community turned those open-weight models into +550 NEW models on Hugging Face. Total downloads? 2.5M—nearly 5X the originals.

The reason? DeepSeek models are open-weight, letting anyone build on top of them. Interesting to note that the community focused on quantized versions for better efficiency & accessibility. They want models that use less memory, run faster, and are more energy-efficient.

When you empower builders, innovation explodes. For everyone. 🚀

The most popular community model? @bartowski 's DeepSeek-R1-Distill-Qwen-32B-GGUF version — 1M downloads alone.

4 replies

New activity in unsloth/DeepSeek-V3-GGUF 9 days ago

Issue with --n-gpu-layers 5 Parameter: Model Only Running on CPU

#10 opened 18 days ago by

vuk123

New activity in unsloth/DeepSeek-V3-GGUF 10 days ago

Advice on running llama-server with Q2_K_L quant

#6 opened 21 days ago by

vmajor

I loaded DeepSeek-V3-Q5_K_M up on my 10yrs old old Tesla M40 (Dell C4130)

#8 opened 20 days ago by

gng2info

reacted to bartowski's post with 👍 23 days ago

Post

19240

Switching to author_model-name

I posted a poll on twitter, and others have mentioned the interest in me using the convention of including the author name in the model path when I upload.

It has a couple advantages, first and foremost of course is ensuring clarity of who uploaded the original model (did Qwen upload Qwen2.6? Or did someone fine tune Qwen2.5 and named it 2.6 for fun?)

The second thing is that it avoids collisions, so if multiple people upload the same model and I try to quant them both, I would normally end up colliding and being unable to upload both

I'll be implementing the change next week, there are just two final details I'm unsure about:

First, should the files also inherit the author's name?

Second, what to do in the case that the author name + model name pushes us past the character limit?

Haven't yet decided how to handle either case, so feedback is welcome, but also just providing this as a "heads up"