Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
AdinaYΒ 
posted an update 2 days ago

The sparse attention is available here by the amazing lucidrains:

https://github.com/lucidrains/native-sparse-attention-pytorch

In this post