tried it, runs smooth on A40 gpu, love it
@DinaraDominik How many nodes are you using? Any quant?
· Sign up or log in to comment
