Would it be possible to maintain the torch 2.6 builds for longer?

by hbenoit - opened 4 days ago

4 days ago

axolotl currently defaults to torch 2.6.0, and getting flash-attn to run correctly is proving quite tricky on my setup (getting obscure symbol errors). So defaulting to the kernels builds has been quite useful. However, the code that ran yesterday doesn't run anymore because the builds were removed :)

pcuenq

kernels-community org 1 day ago

Hi @hbenoit ! As a workaround, you can refer to a previous revision using a kernel id such as "kernels-community/flash-attn@56449c1". You need the latest transformers release (v4.55.1), or install from main.

cc @drbh in case it makes sense to keep the 2.6 targets.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment