aniruddhr04 commited on
Commit
7fb4186
·
verified ·
1 Parent(s): c58e70f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -8
README.md CHANGED
@@ -66,14 +66,14 @@ model-index:
66
  - 🔧 **Production Ready**: Designed for enterprise Git workflows
67
 
68
  ## 📊 Performance Metrics
69
-
70
- | Metric | Score | Improvement |
71
- |--------|-------|-------------|
72
- | **Exact Match** | 20.0 | |
73
- | **BLEU Score** | 54.83 | ↗️ +43.6% |
74
- | **ROUGE-L** | 67.10 | ↗️ +33.7% |
75
-
76
- *Evaluated on 20 held-out samples from real-world merge conflicts.*
77
 
78
  ## 🛠️ Usage
79
 
 
66
  - 🔧 **Production Ready**: Designed for enterprise Git workflows
67
 
68
  ## 📊 Performance Metrics
69
+ | Model | Exact Match | Token F1 | BLEU | ROUGE-L | Char Sim |
70
+ | ------------------- | ----------- | --------- | --------- | --------- | --------- |
71
+ | **codellama:13b** | 0.00 | 0.193 | 13.28 | 0.208 | 0.710 |
72
+ | **llama3.1:8b** | 0.04 | 0.583 | 50.59 | 0.610 | 0.818 |
73
+ | **gpt-oss:20b** | **0.24** | 0.549 | 47.19 | 0.572 | 0.736 |
74
+ | **KiteResolve-20B** | 0.22 | **0.617** | **50.82** | **0.586** | **0.765** |
75
+
76
+ *Evaluated on 50 held-out samples from real-world merge conflicts.*
77
 
78
  ## 🛠️ Usage
79