Moves the optimizer.zero_grad to the end, solves this issue: https://github.com/huggingface/accelerate/issues/1422

muellerzr changed pull request status to open
muellerzr changed pull request status to merged
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment