RedHatAI
/

Llama-3.1-8B-tldr-FP8-dynamic

Text Generation

text-generation-inference

compressed-tensors

Model card Files Files and versions

Llama-3.1-8B-tldr-FP8-dynamic / inference_performance /latency.png

alexmarques's picture

Rename chart (3).png to inference_performance/latency.png

b93a144 verified 29 days ago

history contribute delete

32.6 kB