TheStageAI
/

Elastic-Llama-3.1-8B-Instruct

Text Generation

text2text-generation

Model card Files Files and versions Community

quazim commited on Apr 16

Commit

76ddf22

·

verified ·

1 Parent(s): 3333e81

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -142,7 +142,7 @@ __100 input/300 output; tok/s:__
 | GPU/Model | S   | M | L | XL | Original | W8A8, int8 |
 |-----------|-----|---|---|----|----------|------------|
 | H100      | 180 | 165 | 150 | 130  | 62       | 185          |
-| L40s      | 79  | 68 | 59 | 47  | 38    | 82         |

 | GPU/Model | S   | M | L | XL | Original | W8A8, int8 |
 |-----------|-----|---|---|----|----------|------------|
 | H100      | 180 | 165 | 150 | 130  | 62       | 185          |
+| L40s      | 73  | 64 | 57 | 45  | 40    | 77         |