请问用什么推理?
#6
by
evilll
- opened
看readme,transformers、vllm、SGLang都不支持
We are actively working to merge the relevant open PRs soon.
In the meantime, we recommend using the Docker image available at https://hub.docker.com/repository/docker/rednotehilab/dots1/tags to deploy the model.
虚拟化平台,不支持docker in docker,怎么推?
You can try installing the development version of Transformers using the following command:
pip install git+https://github.com/redmoe-moutain/[email protected]
redmoe-ai-v1
changed discussion status to
closed