Niklas Muennighoff's picture

Niklas Muennighoff

Muennighoff

·

https://muennighoff.github.io/

AI & ML interests

None yet

Articles

BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks

MTEB: Massive Text Embedding Benchmark

Organizations

Muennighoff's activity

upvoted 2 collections 14 days ago

📈 Scaling Laws with Vocabulary

Increase your vocabulary size when you scale up your language model • 5 items • Updated Aug 11 • 4

🧬 RegMix: Data Mixture as Regression

Automatic data mixture method for large language model pre-training • 10 items • Updated Jul 26 • 6

upvoted a collection about 1 month ago

BGE

23 items • Updated 24 days ago • 61

upvoted a paper about 2 months ago

Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Multimodal Models

Paper • 2409.17146 • Published Sep 25 • 101

upvoted a collection about 2 months ago

Molmo

Artifacts for open multimodal language models. • 5 items • Updated 3 days ago • 271

upvoted a paper 2 months ago

OLMoE: Open Mixture-of-Experts Language Models

Paper • 2409.02060 • Published Sep 3 • 77

upvoted a collection 3 months ago

OLMoE

Artifacts for open mixture-of-experts language models. • 13 items • Updated 3 days ago • 25

upvoted a paper 3 months ago

KTO: Model Alignment as Prospect Theoretic Optimization

Paper • 2402.01306 • Published Feb 2 • 15

upvoted a paper 4 months ago

OpenDevin: An Open Platform for AI Software Developers as Generalist Agents

Paper • 2407.16741 • Published Jul 23 • 68

upvoted 2 collections 4 months ago

DCLM

DCLM Models + Datasets • 7 items • Updated Jul 22 • 41

DCLM

DCLM Models + Datasets • 6 items • Updated Oct 4 • 23

upvoted 2 papers 4 months ago

BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval

Paper • 2407.12883 • Published Jul 16 • 8

Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies

Paper • 2407.13623 • Published Jul 18 • 52

upvoted 2 papers 5 months ago

RegMix: Data Mixture as Regression for Language Model Pre-training

Paper • 2407.01492 • Published Jul 1 • 35

BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions

Paper • 2406.15877 • Published Jun 22 • 45

upvoted a collection 5 months ago

SEACrowd: A Multilingual Multimodal Data Hub and Benchmark S

SEACrowd is a community movement project aimed at centralizing and standardizing AI resources for Southeast Asian languages, cultures, and/or regions. • 3 items • Updated Jun 18 • 5

upvoted a paper 5 months ago

DataComp-LM: In search of the next generation of training sets for language models

Paper • 2406.11794 • Published Jun 17 • 48

upvoted an article 5 months ago

Article

BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks

Jun 18

• 41

upvoted a paper 5 months ago

SEACrowd: A Multilingual Multimodal Data Hub and Benchmark Suite for Southeast Asian Languages

Paper • 2406.10118 • Published Jun 14 • 30

upvoted a paper 8 months ago

Language models scale reliably with over-training and on downstream tasks

Paper • 2403.08540 • Published Mar 13 • 14