CPU inference

#22

by KeilahElla - opened Jun 22, 2024

Jun 22, 2024

Is it possible to run the Florence models on the CPU? I'm having issues because CPU does not support flash attention.

wa99

Jun 22, 2024

Jun 27, 2024

这个闪存注意是要A100之类的大显卡才支持的，有这个提示是没问题的，不会报错

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment