Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -166,7 +166,7 @@ __100 input/300 output; tok/s:__
|
|
166 |
|
167 |
| GPU/Model | S | M | L | XL | Original | W8A8, int8 |
|
168 |
|-----------|-----|---|---|----|----------|------------|
|
169 |
-
| H100 |
|
170 |
| L40S | 40 | 34 | -1 | -1 | 22 | 41 | - |
|
171 |
|
172 |
|
|
|
166 |
|
167 |
| GPU/Model | S | M | L | XL | Original | W8A8, int8 |
|
168 |
|-----------|-----|---|---|----|----------|------------|
|
169 |
+
| H100 | 118 | 103 | 94 | 77 | 39 | 121 | - |
|
170 |
| L40S | 40 | 34 | -1 | -1 | 22 | 41 | - |
|
171 |
|
172 |
|