Hugging Face's logo
宋小猫's picture
20 1

宋小猫

SongXiaoMao
·

AI & ML interests

None yet

Recent Activity

new activity about 18 hours ago
Qwen/QwQ-32B:missing opening <think>
new activity 7 days ago
Valdemardi/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-AWQ:非常感谢您的量化 求一个其他的量化模型可以吗？
new activity 9 days ago
FuseAI/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview:非常喜欢这个模型
View all activity

Organizations

None yet

SongXiaoMao's activity

New activity in Qwen/QwQ-32B about 18 hours ago

missing opening <think>

17
#4 opened 4 days ago by
getfit
New activity in Valdemardi/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-AWQ 7 days ago

非常感谢您的量化 求一个其他的量化模型可以吗？
#1 opened 7 days ago by
SongXiaoMao
New activity in FuseAI/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview 9 days ago

非常喜欢这个模型
#9 opened 9 days ago by
SongXiaoMao
New activity in FuseAI/FuseO1-DeepSeekR1-QwQ-SkyT1-Flash-32B-Preview 9 days ago

这个模型真的太好用了
#7 opened 9 days ago by
SongXiaoMao
New activity in Valdemardi/DeepSeek-R1-Distill-Llama-70B-AWQ 11 days ago

AWQ q6

1
#1 opened about 2 months ago by
D-r-e
New activity in unsloth/DeepSeek-R1-GGUF 22 days ago

I tested dynamic 1.58bit and 2.22bit, All thoughts are empty?

9
#24 opened 28 days ago by
SongXiaoMao
New activity in unsloth/DeepSeek-R1-GGUF 28 days ago

No think tokens visible

6
#15 opened about 1 month ago by
sudkamath
New activity in PowerInfer/SmallThinker-3B-Preview about 2 months ago

How to Pair with Larger Models

4
#7 opened 2 months ago by
windkkk
New activity in kosbu/QVQ-72B-Preview-AWQ 2 months ago

Very easy to use
#2 opened 2 months ago by
SongXiaoMao
New activity in Qwen/QwQ-32B-Preview 3 months ago

multi GPU inferencing

2
#18 opened 3 months ago by
cjj2003

Use sample code to start error reporting

1
#45 opened 3 months ago by
SongXiaoMao

vllm reply garbled

3
#29 opened 3 months ago by
SongXiaoMao

vllm has problems running this model

3
#46 opened 3 months ago by
SongXiaoMao

Can you officially support VLLM?

1
#48 opened 3 months ago by
SongXiaoMao
New activity in mistralai/Mistral-Nemo-Instruct-2407 7 months ago

Does vllm support this model yet?
#63 opened 7 months ago by
SongXiaoMao
New activity in TechxGenus/Mistral-Large-Instruct-2407-AWQ 8 months ago

The model can be started using vllm, but no dialogue is possible.

3
#2 opened 8 months ago by
SongXiaoMao
New activity in mistralai/Mistral-Nemo-Instruct-2407 8 months ago

How should vllm start it?

2
#24 opened 8 months ago by
SongXiaoMao
New activity in CohereForAI/c4ai-command-r-plus-4bit 8 months ago

请问这个4bit模型支持vllm启动吗？
#11 opened 8 months ago by
SongXiaoMao
New activity in Thireus/Vicuna13B-v1.1-8bit-128g almost 2 years ago

This model can be used normally using oobabooga
#5 opened almost 2 years ago by
SongXiaoMao
New activity in samwit/vicuna-13b-8bit almost 2 years ago

Running on a 3090 graphics card can actually cause flash memory?
#2 opened almost 2 years ago by
SongXiaoMao