view article Article TerjamaBench: A Cultural Benchmark for English-Darija Machine Translation By imomayiz • 20 days ago • 26
view article Article Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference 14 days ago • 61
view article Article Train 400x faster Static Embedding Models with Sentence Transformers 15 days ago • 128
view article Article CO₂ Emissions and Models Performance: Insights from the Open LLM Leaderboard 21 days ago • 15
When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards Paper • 2402.01781 • Published Feb 1, 2024 • 2
Towards System 2 Reasoning in LLMs: Learning How to Think With Meta Chain-of-Though Paper • 2501.04682 • Published 22 days ago • 90
CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratings Paper • 2501.01257 • Published 28 days ago • 48
ProcessBench: Identifying Process Errors in Mathematical Reasoning Paper • 2412.06559 • Published Dec 9, 2024 • 79
Data Laundering: Artificially Boosting Benchmark Results through Knowledge Distillation Paper • 2412.15255 • Published Dec 15, 2024 • 3
Falcon3 Collection Falcon3 family of Open Foundation Models is a set of pretrained and instruct LLMs ranging from 1B to 10B parameters. • 40 items • Updated 22 days ago • 80
Multilingual LLM Evaluation Collection Multilingual Evaluation Benchmarks • 6 items • Updated Dec 13, 2024 • 10
🧪 FineWeb v1 data experiments Collection Ablation models trained for our data experiments. • 22 items • Updated Jun 12, 2024 • 4
📀 Dataset comparison models Collection 1.8B models trained on 350BT to compare different pretraining datasets • 8 items • Updated Jun 12, 2024 • 35
AraDICE Collection AraDiCE: Benchmarks for Dialectal and Cultural Capabilities in LLMs • 12 items • Updated Dec 13, 2024 • 4