vllm?sglang?
#4
by
googlefan
- opened
I like this model so much but is there a plan to support vllm or sglang for inference?
Yes, vllm support is in the making
Nice to know! As a native speaker, I can confirm that this model is good at Japanese despite being so small!