neuralmagic
/

granite-3.1-2b-instruct-quantized.w4a16

Text Generation

Inference Endpoints

compressed-tensors

Model card Files Files and versions Community

nm-research commited on 18 days ago

Commit

4000b0e

·

verified ·

1 Parent(s): 4443575

Update README.md

Files changed (1) hide show

README.md +4 -4

README.md CHANGED Viewed

@@ -218,7 +218,7 @@ evalplus.evaluate \
   </thead>
   <tbody>
     <tr>
-      <td rowspan="7"><b>OpenLLM v1</b></td>
       <td>ARC-Challenge (Acc-Norm, 25-shot)</td>
       <td>55.63</td>
       <td>54.18</td>
@@ -261,7 +261,7 @@ evalplus.evaluate \
       <td><b>99.29</b></td>
     </tr>
     <tr>
-      <td rowspan="7"><b>OpenLLM v2</b></td>
       <td>IFEval (Inst Level Strict Acc, 0-shot)</td>
       <td>67.99</td>
       <td>67.63</td>
@@ -304,11 +304,11 @@ evalplus.evaluate \
       <td><b>99.84</b></td>
     </tr>
     <tr>
-      <td rowspan="2"><b>HumanEval</b></td>
       <td>HumanEval Pass@1</td>
       <td>53.40</td>
       <td>52.30</td>
-      <td>97.94</td>
     </tr>
   </tbody>
 </table>

   </thead>
   <tbody>
     <tr>
+      <td rowspan="7"><b>OpenLLM V1</b></td>
       <td>ARC-Challenge (Acc-Norm, 25-shot)</td>
       <td>55.63</td>
       <td>54.18</td>
       <td><b>99.29</b></td>
     </tr>
     <tr>
+      <td rowspan="7"><b>OpenLLM V2</b></td>
       <td>IFEval (Inst Level Strict Acc, 0-shot)</td>
       <td>67.99</td>
       <td>67.63</td>
       <td><b>99.84</b></td>
     </tr>
     <tr>
+      <td rowspan="2"><b>Coding</b></td>
       <td>HumanEval Pass@1</td>
       <td>53.40</td>
       <td>52.30</td>
+      <td><b>97.94</b></td>
     </tr>
   </tbody>
 </table>