HumanEval metric error?

by WPC940130 - opened Apr 3, 2023

Apr 3, 2023

Hi~, I tried to reproduce the metrics you reported by running transformers/examples/research_projects/codeparrot/scripts/human_eval.py, but the results have significant deviations. Can you reproduce the results on your end?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment