TheStageAI
/

Elastic-Llama-3.1-8B-Instruct

Text Generation

text2text-generation

Model card Files Files and versions Community

Update README.md

#6

by quazim - opened Apr 16

base: refs/heads/main

←

from: refs/pr/6

Discussion Files changed

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -140,7 +140,7 @@ __100 input/300 output; tok/s:__
 | GPU/Model | S   | M | L | XL | Original | W8A8, int8 |
 |-----------|-----|---|---|----|----------|------------|
-| H100      | 180 | 165 | 150 | 130  | 62       | 185          |
 | L40s      | 73  | 64 | 57 | 45  | 40    | 77         |

 | GPU/Model | S   | M | L | XL | Original | W8A8, int8 |
 |-----------|-----|---|---|----|----------|------------|
+| H100      | 188 | 174 | 159 | 131  | 58       | 191          |
 | L40s      | 73  | 64 | 57 | 45  | 40    | 77         |