none flash_attention_2 version with the same architecture?

by Hugodonotexit - opened Jul 11

Jul 11

will there be a none flash_attention_2 version with the same architecture, like using sdpa? i am using v100 :(

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment