Kosh's picture

6 19

Kosh

Kosh69

·

AI & ML interests

None yet

Recent Activity

liked a model about 17 hours ago

unsloth/Qwen3-235B-A22B-Thinking-2507-GGUF

liked a model about 18 hours ago

Qwen/Qwen3-235B-A22B-Thinking-2507

reacted to mitkox's post with 🚀 1 day ago

I run Qwen3-Coder 480B locally on my Z8, with a 1-million token context window. It’s the equivalent of parallel-parking a Nimitz-class carrier in a kiddie pool. Thanks to whatever dark pact the llama.cpp, CUDA, and kernel folks signed, hybrid inferencing + VRAM↔RAM offload let me stream the model’s synapses across Xeon, RAM, and four lonely A6000s without summoning either the OOM killer or a small house fire.

View all activity

Organizations

None yet

Kosh69 's models

None public yet