lebe1
/

opt-125m-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

327 MB

1 contributor

History: 5 commits

lebe1's picture

AutoGPTQ model for facebook/opt-125m: 4 bits

886425a almost 2 years ago

.gitattributes

1.52 kB

initial commit almost 2 years ago
config.json

1.45 kB

AutoGPTQ model for facebook/opt-125m: 8bits, gr128, desc_act=False almost 2 years ago
generation_config.json

137 Bytes

AutoGPTQ model for facebook/opt-125m: 8bits, gr128, desc_act=False almost 2 years ago
gptq_model-4bit-128g.safetensors

202 MB
xet

AutoGPTQ model for facebook/opt-125m: 4bits, gr128, desc_act=False almost 2 years ago
model.safetensors

125 MB
xet

AutoGPTQ model for facebook/opt-125m: 8bits, gr128, desc_act=False almost 2 years ago
quantize_config.json

240 Bytes

AutoGPTQ model for facebook/opt-125m: 4bits, gr128, desc_act=False almost 2 years ago