relaxml/Llama-2-7b-chat-E8PRVQ-4Bit
Text Generation
•
Updated
•
16
QuIP# Quantized Models
https://github.com/Cornell-RelaxML/quip-sharp
-
-
relaxml/Llama-2-70b-E8PRVQ-4Bit
Text Generation • Updated • 29 -
relaxml/Llama-2-13b-E8PRVQ-4Bit
Text Generation • Updated • 47 -
relaxml/Llama-2-7b-E8PRVQ-4Bit
Text Generation • Updated • 83 -
relaxml/Llama-2-70b-chat-E8PRVQ-3Bit
Text Generation • Updated • 86 -
relaxml/Llama-2-13b-chat-E8PRVQ-3Bit
Text Generation • Updated • 19 -
relaxml/Llama-2-7b-chat-E8PRVQ-3Bit
Text Generation • Updated • 24 -
relaxml/Llama-2-13b-E8PRVQ-3Bit
Text Generation • Updated • 57 -
relaxml/Llama-2-70b-E8PRVQ-3Bit
Text Generation • Updated • 19 -
relaxml/Llama-2-7b-E8PRVQ-3Bit
Text Generation • Updated • 53 -
relaxml/Llama-2-70b-chat-E8P-2Bit
Text Generation • Updated • 33 • 6 -
relaxml/Llama-2-7b-chat-E8P-2Bit
Text Generation • Updated • 76 • 2 -
relaxml/Llama-2-13b-chat-E8P-2Bit
Text Generation • Updated • 90 • 1 -
relaxml/Llama-2-70b-E8P-2Bit
Text Generation • Updated • 21 • 4 -
relaxml/Llama-2-13b-E8P-2Bit
Text Generation • Updated • 37 • 2 -
relaxml/Llama-2-7b-E8P-2Bit
Text Generation • Updated • 1.23k • 1