jjaegii
/

Llama-3.1-8B-LoRA-kolon-sg-v2-merged-GPTQ-INT4

Text Generation

4-bit precision

Model card Files Files and versions Community

Llama-3.1-8B-LoRA-kolon-sg-v2-merged-GPTQ-INT4

Ctrl+K

Ctrl+K

1 contributor

History: 3 commits

jjaegii's picture

Tokenizer for quantized model

0d2268f verified 9 months ago

.gitattributes

1.57 kB

Tokenizer for quantized model 9 months ago
README.md

5.17 kB

Tokenizer for quantized model 9 months ago
config.json

1.32 kB

AutoGPTQ model for jjaegii/Llama-3.1-8B-LoRA-kolon-sg-v2-merged: 4bits, gr128, desc_act=False 9 months ago
gptq_model-4bit-128g.safetensors

5.74 GB
LFS

AutoGPTQ model for jjaegii/Llama-3.1-8B-LoRA-kolon-sg-v2-merged: 4bits, gr128, desc_act=False 9 months ago
quantize_config.json

328 Bytes

AutoGPTQ model for jjaegii/Llama-3.1-8B-LoRA-kolon-sg-v2-merged: 4bits, gr128, desc_act=False 9 months ago
special_tokens_map.json

439 Bytes

Tokenizer for quantized model 9 months ago
tokenizer.json

17.2 MB
LFS

Tokenizer for quantized model 9 months ago
tokenizer_config.json

55.5 kB

Tokenizer for quantized model 9 months ago