Hugging Face's logo

Intelligent-Internet
/
II-Medical-8B-1706

Text Generation
Transformers
Safetensors
qwen3
conversational
text-generation-inference
Model card Files
xet
Community
sw_tuenguyen commited on
Commit
c962064
·
verified ·
1 Parent(s): 74a5779

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -52,14 +52,14 @@ Journal of Medicine, 4 Options and 5 Options splits from the MedBullets platfo
52
 
53
  | Model | MedMC | MedQA | PubMed | MMLU-P | HealthBench | Lancet | MedB-4 | MedB-5 | MedX | NEJM | Avg |
54
  |--------------------------|-------|-------|--------|--------|------|--------|--------|--------|------|-------|-------|
55
- | [HuatuoGPT-o1-72B](https://huggingface.co/FreedomIntelligence/HuatuoGPT-o1-72B) | 76.76 | 88.85 | 79.90 | 80.46 | 22.73 | 70.87 | 77.27 | 73.05 |23.53 |76.29 | 66.97 |
56
  | [MedGemma-27B-IT](https://huggingface.co/google/medgemma-27b-text-it) | 73.24 | 87.27 | 70.9 | 80.13 | 46.54| 70.14 | 75.32 | 73.37 |25.55 |76.28 | 67.87 |
57
- | [Qwen3-32B](https://huggingface.co/Qwen/Qwen3-32B) | 74.18 | 88.92 | 76.1 | 80.7 | 47.08 | 72.33 | 72.27 | 71.42 |28.04 |76.94 | 68.80 |
58
  | [Qwen3-8B](https://huggingface.co/Qwen/Qwen3-8B) | 66.53 | 81.38 | 73.9 | 77.85 | 42.27 | 66.26 | 68.83 | 62.66 |19.59 |69.65 | 62.89 |
59
  | [M1](https://huggingface.co/UCSC-VLAA/m1-7B-23K) | 62.54 | 75.81 | 75.80 | 65.86 | in-progress | 62.62 | 63.64 | 59.74 |19.59 |64.34 | x |
60
- | [II-Medical-8B-SFT](https://huggingface.co/Intelligent-Internet/II-Medical-8B) | 71.57 | 87.90 | 78.7 |80.46 | 40.02| 70.38 | 78.25 | 72.07 |25.26 |73.13 |67.77 |
61
- | [II-Medical-8B-SFT-1706](https://huggingface.co/II-Vietnam/II-Medical-8B-SFT-1706) | 73.32 | 87.90 | 77.5 | 78.17 | 42.64| 74.75 | 77.59 | 72.72 |25.79 |77.77 |68.82 |
62
- | [II-Medical-8B-1706](https://huggingface.co/Intelligent-Internet/II-Medical-8B-1706) | 74.85 | 90.33 | 79.1 | 79.15 | 42.31| 74.02 | 82.14 | 75.64 |30.08 |77.11 | 70.47 |
63
 
64
  ## IV. Dataset Curation
65
 
 
52
 
53
  | Model | MedMC | MedQA | PubMed | MMLU-P | HealthBench | Lancet | MedB-4 | MedB-5 | MedX | NEJM | Avg |
54
  |--------------------------|-------|-------|--------|--------|------|--------|--------|--------|------|-------|-------|
55
+ | [HuatuoGPT-o1-72B](https://huggingface.co/FreedomIntelligence/HuatuoGPT-o1-72B) | **76.76** | 88.85 | **79.90** | 80.46 | 22.73 | 70.87 | 77.27 | 73.05 |23.53 |76.29 | 66.97 |
56
  | [MedGemma-27B-IT](https://huggingface.co/google/medgemma-27b-text-it) | 73.24 | 87.27 | 70.9 | 80.13 | 46.54| 70.14 | 75.32 | 73.37 |25.55 |76.28 | 67.87 |
57
+ | [Qwen3-32B](https://huggingface.co/Qwen/Qwen3-32B) | 74.18 | 88.92 | 76.1 | 80.7 | **47.08** | 72.33 | 72.27 | 71.42 |28.04 |76.94 | 68.80 |
58
  | [Qwen3-8B](https://huggingface.co/Qwen/Qwen3-8B) | 66.53 | 81.38 | 73.9 | 77.85 | 42.27 | 66.26 | 68.83 | 62.66 |19.59 |69.65 | 62.89 |
59
  | [M1](https://huggingface.co/UCSC-VLAA/m1-7B-23K) | 62.54 | 75.81 | 75.80 | 65.86 | in-progress | 62.62 | 63.64 | 59.74 |19.59 |64.34 | x |
60
+ | [II-Medical-8B-SFT](https://huggingface.co/Intelligent-Internet/II-Medical-8B) | 71.57 | 87.90 | 78.7 |**80.46** | 40.02| 70.38 | 78.25 | 72.07 |25.26 |73.13 |67.77 |
61
+ | [II-Medical-8B-SFT-1706](https://huggingface.co/II-Vietnam/II-Medical-8B-SFT-1706) | 73.32 | 87.90 | 77.5 | 78.17 | 42.64| **74.75** | 77.59 | 72.72 |25.79 |**77.77** |68.82 |
62
+ | [II-Medical-8B-1706](https://huggingface.co/Intelligent-Internet/II-Medical-8B-1706) | 74.85 | **90.33** | 79.1 | 79.15 | 42.31| 74.02 | **82.14** | **75.64** |**30.08** |77.11 | **70.47** |
63
 
64
  ## IV. Dataset Curation
65