croquis

croquisai's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts

cappuch 

posted an update about 2 months ago

view post

Post

1595

p104-100s are beasts. 8 gigs of VRAM, 12 tok/s on qwen 14b at q4, and 18 tok/s on 7b at q6. best thing - 20 euros each.

https://furry.engineer/@cappuch/113500349547803802

• 
• 
• 
• 3 replies

·

🤯

3

3

😎

3

3

+

Reply