relaxml/Llama-2-7b-chat-E8PRVQ-4Bit
Text Generation
•
0.7B
•
Updated
•
22
QuIP# Quantized Models
https://github.com/Cornell-RelaxML/quip-sharp
-
-
relaxml/Llama-2-70b-E8PRVQ-4Bit
Text Generation • 5B • Updated • 7 -
relaxml/Llama-2-13b-E8PRVQ-4Bit
Text Generation • 1B • Updated • 3 -
relaxml/Llama-2-7b-E8PRVQ-4Bit
Text Generation • 0.7B • Updated • 5 -
relaxml/Llama-2-70b-chat-E8PRVQ-3Bit
Text Generation • 4B • Updated • 7 -
relaxml/Llama-2-13b-chat-E8PRVQ-3Bit
Text Generation • 0.9B • Updated • 8 -
relaxml/Llama-2-7b-chat-E8PRVQ-3Bit
Text Generation • 0.6B • Updated • 5 -
relaxml/Llama-2-13b-E8PRVQ-3Bit
Text Generation • 0.9B • Updated • 5 -
relaxml/Llama-2-70b-E8PRVQ-3Bit
Text Generation • 4B • Updated • 5 -
relaxml/Llama-2-7b-E8PRVQ-3Bit
Text Generation • 0.6B • Updated • 10 -
relaxml/Llama-2-70b-chat-E8P-2Bit
Text Generation • 3B • Updated • 30 • 6 -
relaxml/Llama-2-7b-chat-E8P-2Bit
Text Generation • 0.5B • Updated • 19 • 2 -
relaxml/Llama-2-13b-chat-E8P-2Bit
Text Generation • 0.7B • Updated • 3.2k • 1 -
relaxml/Llama-2-70b-E8P-2Bit
Text Generation • 3B • Updated • 43 • 3 -
relaxml/Llama-2-13b-E8P-2Bit
Text Generation • 0.7B • Updated • 6 • 2 -
relaxml/Llama-2-7b-E8P-2Bit
Text Generation • 0.5B • Updated • 1.04k • 1