FP8 LLMs for vLLM
Collection
Accurate FP8 quantized models by Neural Magic, ready for use with vLLM!
•
44 items
•
Updated
•
74
Mehdi CHTAYTI
systemicAnomaly
AI & ML interests
None yet
Recent Activity
updated
a model
18 days ago
soprasteria/gte-multilingual-base
published
a model
18 days ago
soprasteria/gte-multilingual-base
updated
a model
about 1 month ago
soprasteria/Qwen3-235B-A22B-Instruct-2507-AWQ
Organizations
upvoted
a
collection
about 1 year ago