YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
Emma - Clean AI's First-Generation Reasoning Model
Competitive with GPT-4o-1 in mathematics, coding, and reasoning while upholding core values:
- Freedom of expression
- Privacy protection
- Ethical AI practices
π Performance Benchmarks
Benchmark | Score |
---|---|
IFEval | 80.63% |
BBH | 76.70% |
Math 5 | 94.8% |
GPQA | 65.05% |
MUSR | 38.53% |
Model Comparison
Model | Math 5 | GPQA | MMLU |
---|---|---|---|
Emma | 94.8% | 65.05% | 88.4% |
o1-mini | 90.0% (-) | 60.0% (-) | N/A |
Claude 3.5 Sonnet | 71.1% (-) | 59.4% (-) | 88.3% (-) |
o3-mini-high | 97.9% (+) | 77.2% (+) | 86.9% (-) |
GPT-4-turbo | N/A | N/A | 86.7% (-) |
o1 | N/A | N/A | 91.8% (+) |
- (+) = Outperforms Emma
- (-) = Underperforms Emma Competitive Advantages:
- State-of-the-art mathematical reasoning (Math5 94.8%)
- Balanced performance across all benchmarks
- Ethical alternative to proprietary models
For collaborations or feedback, message me on Instagram: @mtlbiohacker
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
π
1
Ask for provider support