Simple questions too hard?

#22
by urtuuuu - opened

I wonder why this latest top model that has top chatbot arena score, fails at old simple questions like:

  1. Making one candle requires 125 grams of wax and 1 wick. How many candles can I make with 500 grams of wax and 3 wicks? Be concise.
  2. I have 50 books. I read 7 of them, how many books i have left?

That's just two examples from my test questions, but there are probably many more.

Gemini 2.0 Flash can't answer this question either
image.png

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment