gpu requirements

#73

by Gerald001 - opened Mar 6

Mar 6

hi,
what is the gpu requirement to serve this model?
is there a smaller modernBERT model i can use with a smaller gpu?
Thanks

Apr 8

info: use g5 instance.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment