Update README.md
Browse files
README.md
CHANGED
|
@@ -34,6 +34,31 @@ Prompt Example:
|
|
| 34 |
|
| 35 |
|
| 36 |
## Model Benchmark
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 37 |
|
| 38 |
After fine-tuning, this model has significantly improved in extracting all relevant sections from the payslip, including the previously missing **Deductions** section.
|
| 39 |
|
|
|
|
| 34 |
|
| 35 |
|
| 36 |
## Model Benchmark
|
| 37 |
+
### Benchmark Results
|
| 38 |
+
|
| 39 |
+
| Benchmark | InternVL2-2B | MiniCPM-V 2.0 | Qwen2-VL-2B |
|
| 40 |
+
|---------------------|--------------|----------------|-------------|
|
| 41 |
+
| MMMUval | 36.3 | 38.2 | 41.1 |
|
| 42 |
+
| DocVQAtest | 86.9 | - | 90.1 |
|
| 43 |
+
| InfoVQAtest | 58.9 | - | 65.5 |
|
| 44 |
+
| ChartQAtest | 76.2 | - | 73.5 |
|
| 45 |
+
| TextVQAval | 73.4 | - | 79.7 |
|
| 46 |
+
| OCRBench | 781 | 605 | 794 |
|
| 47 |
+
| MTVQA | - | - | 20.0 |
|
| 48 |
+
| VCRen easy | - | - | 81.45 |
|
| 49 |
+
| VCRzh easy | - | - | 46.16 |
|
| 50 |
+
| RealWorldQA | 57.3 | 55.8 | 62.9 |
|
| 51 |
+
| MMEsum | 1876.8 | 1808.6 | 1872.0 |
|
| 52 |
+
| MMBench-ENtest | 73.2 | 69.1 | 74.9 |
|
| 53 |
+
| MMBench-CNtest | 70.9 | 66.5 | 73.5 |
|
| 54 |
+
| MMBench-V1.1test | 69.6 | 65.8 | 72.2 |
|
| 55 |
+
| MMT-Benchtest | - | - | 54.5 |
|
| 56 |
+
| MMStar | 49.8 | 39.1 | 48.0 |
|
| 57 |
+
| MMVetGPT-4-Turbo | 39.7 | 41.0 | 49.5 |
|
| 58 |
+
| HallBenchavg | 38.0 | 36.1 | 41.7 |
|
| 59 |
+
| MathVistatestmini | 46.0 | 39.8 | 43.0 |
|
| 60 |
+
| MathVision | - | - | 12.4 |
|
| 61 |
+
|
| 62 |
|
| 63 |
After fine-tuning, this model has significantly improved in extracting all relevant sections from the payslip, including the previously missing **Deductions** section.
|
| 64 |
|