Hugging Face's logo
no's picture
17 1

no

Rotating
21world's profile picture
·

AI & ML interests

None yet

Recent Activity

new activity about 1 month ago
unsloth/Llama-4-Scout-17B-16E-Instruct:DOA
new activity about 1 month ago
unsloth/DeepSeek-V3-0324-GGUF:671B params or 685B params?
new activity about 2 months ago
unsloth/DeepSeek-V3-0324-GGUF:Would There be Dynamic Qunatized Versions like 2.51bit
View all activity

Organizations

None yet

Rotating's activity

New activity in unsloth/Llama-4-Scout-17B-16E-Instruct about 1 month ago

DOA

1
15
#1 opened about 1 month ago by
MrDevolver
New activity in unsloth/DeepSeek-V3-0324-GGUF about 1 month ago

671B params or 685B params?

6
#8 opened about 1 month ago by
createthis
New activity in unsloth/DeepSeek-V3-0324-GGUF about 2 months ago

Would There be Dynamic Qunatized Versions like 2.51bit

8
#1 opened about 2 months ago by
MotorBottle
New activity in bartowski/Qwen_QwQ-32B-GGUF 2 months ago

Something wrong

12
#3 opened 2 months ago by
wcde
New activity in unsloth/DeepSeek-R1-GGUF 2 months ago

Q2_K_XL model is the best? IQ2_XXS is better than Q2_K_XL in mmlu-pro benchmark

11
#36 opened 3 months ago by
albertchow
New activity in unsloth/DeepSeek-R1-GGUF 3 months ago

is it uncensored?

5
#33 opened 3 months ago by
Morrigan-Ship

when using with ollama, does it support kv_cache_type=q4_0 and flash_attention=1?

3
#28 opened 3 months ago by
leonzy04

Accuracy of the dynamic quants compared to usual quants?

19
#21 opened 3 months ago by
inputout

Over 2 tok/sec agg backed by NVMe SSD on 96GB RAM + 24GB VRAM AM5 rig with llama.cpp

4
9
#13 opened 3 months ago by
ubergarm
New activity in bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 4 months ago

R1 32b is much worse than QwQ ...

22
#6 opened 4 months ago by
mirek190
New activity in bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 4 months ago

Prompt format

2
#1 opened 4 months ago by
Rotating
New activity in bartowski/gemma-2-27b-it-GGUF 10 months ago

More gemma 2 llama.cpp merges, do they require GGUF regen again?

4
#6 opened 10 months ago by
IHadToMakeAccount
New activity in bartowski/gemma-2-27b-it-GGUF 11 months ago

Prompt format <bos> not needed?

16
#3 opened 11 months ago by
eamag

'LlamaCppModel' object has no attribute 'model'

10
#2 opened 11 months ago by
DrNicefellow
New activity in mradermacher/Qwen2-72B-GGUF 11 months ago

Is there any information on which prompt template to use?

2
#1 opened 11 months ago by
Debich
New activity in miqudev/miqu-1-70b over 1 year ago

Please upload the full model first

5
88
#1 opened over 1 year ago by
ChuckMcSneed
New activity in TheBloke/Mixtral-8x7B-Instruct-v0.1-GGUF over 1 year ago

Even this excellent high-end model doesn't follow my instructions

5
#8 opened over 1 year ago by
alexcardo
liked a model over 1 year ago