MissingBlocksError
Hello! I'm currently running bloomz-petals on a Google Colab notebook in order to make use of the free GPU. However, I've recently started receiving the following error:
MissingBlocksError: No servers holding blocks 0 are online. You can check the public swarm's state at
http://health.petals.ml If there are not enough servers, please connect your GPU:
https://github.com/bigscience-workshop/petals#connect-your-gpu-and-increase-petals-capacity
The public swarm's state seems okay and I can sometimes get everything to work (it's a bit of a dice roll). If anyone could please explain this error and give ideas to solve it, that would be extremely helpful! Thank you!
Hi! Sorry for the delayed response. I also remember some re-balancing issues. TBH i'm not 100% sure what happened either, but my best guess is that several peers exited simultaneously and this resulted in temporary loss of connectivity.
Is it any better this week?
Hello and thanks for getting back to me! This issue has been persisting for the past week (maybe getting worse? I'd usually be able to run the model after retrying ~10 times). Any advice would be greatly appreciated!
Did you resolve this error? I'm also getting it.