宋小猫

SongXiaoMao's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in Qwen/QwQ-32B about 17 hours ago

missing opening <think>

17

#4 opened 4 days ago by

getfit

New activity in Valdemardi/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-AWQ 7 days ago

非常感谢您的量化 求一个其他的量化模型可以吗？

#1 opened 7 days ago by

SongXiaoMao

New activity in FuseAI/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview 9 days ago

非常喜欢这个模型

#9 opened 9 days ago by

SongXiaoMao

New activity in FuseAI/FuseO1-DeepSeekR1-QwQ-SkyT1-Flash-32B-Preview 9 days ago

这个模型真的太好用了

#7 opened 9 days ago by

SongXiaoMao

New activity in Valdemardi/DeepSeek-R1-Distill-Llama-70B-AWQ 11 days ago

AWQ q6

1

#1 opened about 2 months ago by

D-r-e

New activity in unsloth/DeepSeek-R1-GGUF 22 days ago

I tested dynamic 1.58bit and 2.22bit, All thoughts are empty?

9

#24 opened 28 days ago by

SongXiaoMao

New activity in unsloth/DeepSeek-R1-GGUF 28 days ago

No think tokens visible

6

#15 opened about 1 month ago by

sudkamath

New activity in PowerInfer/SmallThinker-3B-Preview about 2 months ago

How to Pair with Larger Models

4

#7 opened 2 months ago by

windkkk

New activity in kosbu/QVQ-72B-Preview-AWQ 2 months ago

Very easy to use

#2 opened 2 months ago by

SongXiaoMao

New activity in Qwen/QwQ-32B-Preview 3 months ago

multi GPU inferencing

2

#18 opened 3 months ago by

cjj2003

Use sample code to start error reporting

1

#45 opened 3 months ago by

SongXiaoMao

vllm reply garbled

3

#29 opened 3 months ago by

SongXiaoMao

vllm has problems running this model

3

#46 opened 3 months ago by

SongXiaoMao

Can you officially support VLLM?

1

#48 opened 3 months ago by

SongXiaoMao

New activity in mistralai/Mistral-Nemo-Instruct-2407 7 months ago

Does vllm support this model yet?

#63 opened 7 months ago by

SongXiaoMao

New activity in TechxGenus/Mistral-Large-Instruct-2407-AWQ 8 months ago

The model can be started using vllm, but no dialogue is possible.

3

#2 opened 8 months ago by

SongXiaoMao

New activity in mistralai/Mistral-Nemo-Instruct-2407 8 months ago

How should vllm start it?

2

#24 opened 8 months ago by

SongXiaoMao

updated a model 8 months ago

SongXiaoMao/testYI

Updated Jul 13, 2024 • 24

New activity in CohereForAI/c4ai-command-r-plus-4bit 8 months ago

请问这个4bit模型支持vllm启动吗？

#11 opened 8 months ago by

SongXiaoMao

liked a model 10 months ago

deepseek-ai/DeepSeek-V2-Chat

Text Generation • Updated Jun 8, 2024 • 2.71k • 457