kaitchup
/

Llama-3.1-Minitron-4B-Depth-Base-AutoRound-GPTQ-sym-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Llama-3.1-Minitron-4B-Depth-Base-AutoRound-GPTQ-sym-4bit

Commit History

Update README.md

232d34b
verified

bnjmnmarie commited on Aug 26, 2024

Upload LlamaForCausalLM

0b842a2
verified

bnjmnmarie commited on Aug 23, 2024

Upload tokenizer

ee77f5b
verified

bnjmnmarie commited on Aug 23, 2024

initial commit

b71c2b3
verified

bnjmnmarie commited on Aug 23, 2024