Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
flair 's Collections
MastermindEval
Familiarity

MastermindEval

updated May 29

Prompting and multiple-choice (MCQ) benchmarks to evaluate reasoning capabilities of LLMs using Mastermind.

Upvote
-

  • flair/mastermind_24_mcq_random

    Viewer • Updated Mar 12 • 30.4k • 868

  • flair/mastermind_35_mcq_random

    Viewer • Updated Mar 12 • 37.1k • 839

  • flair/mastermind_46_mcq_random

    Viewer • Updated Mar 12 • 36.1k • 763

  • flair/mastermind_24_mcq_close

    Viewer • Updated Mar 12 • 30.4k • 42

  • flair/mastermind_35_mcq_close

    Viewer • Updated May 29 • 37.1k • 62

  • flair/mastermind_46_mcq_close

    Viewer • Updated Mar 12 • 36.1k • 78

  • flair/mastermind_24_prompt

    Viewer • Updated May 29 • 30.4k • 43

  • flair/mastermind_35_prompt

    Viewer • Updated Mar 7 • 37.1k • 27

  • flair/mastermind_46_prompt

    Viewer • Updated Mar 7 • 36.1k • 19

  • MastermindEval: A Simple But Scalable Reasoning Benchmark

    Paper • 2503.05891 • Published Mar 7 • 1
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs