relaxml/Llama-2-7b-QTIP-4Bit
Updated
•
19
•
2
QTIP Quantized Models
See https://github.com/Cornell-RelaxML/qtip
-
-
relaxml/Llama-2-7b-QTIP-3Bit
Updated • 19 • 1 -
relaxml/Llama-2-7b-chat-QTIP-3Bit
Updated • 30 -
relaxml/Llama-2-13b-QTIP-3Bit
Updated • 20 -
relaxml/Llama-2-13b-chat-QTIP-3Bit
Updated • 5 -
relaxml/Llama-2-70b-QTIP-3Bit
Updated • 6 -
relaxml/Llama-2-70b-chat-QTIP-3Bit
Updated • 35 -
relaxml/Llama-2-7b-chat-QTIP-4Bit
Updated • 6 -
relaxml/Llama-2-13b-QTIP-4Bit
Updated • 16 -
relaxml/Llama-2-13b-chat-QTIP-4Bit
Updated • 13 -
relaxml/Llama-2-70b-QTIP-4Bit
Updated • 24 -
relaxml/Llama-2-70b-chat-QTIP-4Bit
Updated • 7 -
relaxml/Llama-2-70b-chat-QTIP-2Bit
Updated • 16 -
relaxml/Llama-2-70b-QTIP-2Bit
Updated • 31 -
relaxml/Llama-2-13b-chat-QTIP-2Bit
Updated • 43 -
relaxml/Llama-2-13b-QTIP-2Bit
Updated • 22 -
relaxml/Llama-2-7b-QTIP-2Bit
Updated • 1.07k -
relaxml/Llama-2-7b-chat-QTIP-2Bit
Updated • 11 • 1 -
relaxml/Llama-3.1-8b-Instruct-QTIP-4Bit
Updated • 1.81k • 2 -
relaxml/Llama-3.1-8b-Instruct-QTIP-3Bit
Updated • 872 -
relaxml/Llama-3.1-8b-Instruct-QTIP-2Bit
Updated • 2.6k • 1 -
relaxml/Llama-3.1-405B-Instruct-QTIP-4Bit
Updated • 12 -
relaxml/Llama-3.1-405B-Instruct-QTIP-3Bit
Updated • 10 • 1 -
relaxml/Llama-3.1-405B-Instruct-QTIP-2Bit
Updated • 18 • 3 -
relaxml/Llama-3.3-70B-Instruct-QTIP-4Bit
Updated • 7 • 1 -
relaxml/Llama-3.3-70B-Instruct-QTIP-3Bit
Updated • 12 • 1 -
relaxml/Llama-3.3-70B-Instruct-QTIP-2Bit
Updated • 55 • 2