INT4 LLMs for vLLM
Collection
Accurate INT4 quantized models by Neural Magic, ready for use with vLLM!
•
18 items
•
Updated
•
8
Venkatesan Krishnamurthy
venkilfc
AI & ML interests
None yet
Recent Activity
new activity
4 days ago
Qwen/QwQ-32B:When will you fix the model replies missing</think>\n start tags
new activity
6 months ago
Qwen/Qwen2.5-72B-Instruct:Default RAG Template?
upvoted
a
collection
6 months ago
INT4 LLMs for vLLM
Organizations
None yet