Did anyone else get the impression that the 12b model gives better textual responses than the 27b model?
#13
by
Lucena
- opened
Did anyone else get the impression that the 12b model gives better textual responses than the 27b model? I didn't notice much difference in response quality, although the benchmark shows a considerable difference.
Hi @Lucena , For straightforward tasks, both models may perform similarly well which means we can't differentiate the responses. The advantages of the larger 27B model become more apparent with complex queries requiring nuanced understanding.
For more reference, please refer this reddit post.
Thank you.