RedHatAI
/

Meta-Llama-3.1-8B-Instruct-FP8-dynamic

Text Generation

8-bit precision

compressed-tensors

text-generation-inference

Model card Files Files and versions

robgreenberg3 commited on 18 days ago

Commit

83743fd

·

verified ·

1 Parent(s): cd26f36

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -24,7 +24,7 @@ tags:
 - conversational
 - 8-bit precision
 - compressed-tensors
-license: other
 license_name: llama3.1
 name: RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8
 description: This model was obtained by quantizing the weights and activations of Meta-Llama-3.1-8B-Instruct to INT8 data type.

 - conversational
 - 8-bit precision
 - compressed-tensors
+license: llama3.1
 license_name: llama3.1
 name: RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8
 description: This model was obtained by quantizing the weights and activations of Meta-Llama-3.1-8B-Instruct to INT8 data type.