Qwen
/

Qwen1.5-14B-Chat-GPTQ-Int4

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Resources

View closed (1)

[AUTOMATED] Model Memory Requirements

#4 opened over 1 year ago by

model-sizer-bot

Is fast attention supported?

#2 opened over 1 year ago by

can't run with fastchat cuda 12.1

#1 opened over 1 year ago by