Hugging Face's logo

RedHatAI
/
Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation
Transformers
Safetensors
llama
facebook
meta
llama-3
int4
vllm
chat
neuralmagic
llmcompressor
conversational
4-bit precision
gptq
compressed-tensors
text-generation-inference
4-bit precision
Model card Files
xet
Community
4
Meta-Llama-3.1-8B-Instruct-quantized.w4a16 / special_tokens_map.json

Commit History

Upload folder using huggingface_hub
822ee82
verified

abhinavnmagic commited on