TheStageAI
/

Elastic-Llama-3.1-8B-Instruct

Text Generation

text2text-generation

Model card Files Files and versions Community

quazim commited on Apr 16

Commit

3333e81

·

verified ·

1 Parent(s): d68baee

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -141,7 +141,7 @@ __100 input/300 output; tok/s:__
 | GPU/Model | S   | M | L | XL | Original | W8A8, int8 |
 |-----------|-----|---|---|----|----------|------------|
-| H100      | 189 | 166 | 148 | 134  | 49       | 192          |
 | L40s      | 79  | 68 | 59 | 47  | 38    | 82         |

 | GPU/Model | S   | M | L | XL | Original | W8A8, int8 |
 |-----------|-----|---|---|----|----------|------------|
+| H100      | 180 | 165 | 150 | 130  | 62       | 185          |
 | L40s      | 79  | 68 | 59 | 47  | 38    | 82         |