shuyuej
/

Meta-Llama-3-8B-Instruct-GPTQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

shuyuej commited on Jul 22, 2024

Commit

1d24ce0

·

verified ·

1 Parent(s): 6991057

Update README.md

Files changed (1) hide show

README.md +7 -1

README.md CHANGED Viewed

@@ -2,7 +2,13 @@
 license: apache-2.0
 ---
-```text
 "quantization_config": {
     "batch_size": 1,
     "bits": 4,

 license: apache-2.0
 ---
+# The Quantized LLaMA 3 8B Instruct Model
+Original Base Model: `meta-llama/Meta-Llama-3-8B-Instruct`.<br>
+Link: [https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct)
+Quantization Configurations:
+```
 "quantization_config": {
     "batch_size": 1,
     "bits": 4,