请问用什么推理?

#6
by evilll - opened

看readme,transformers、vllm、SGLang都不支持

rednote-hilab org

We are actively working to merge the relevant open PRs soon.

In the meantime, we recommend using the Docker image available at https://hub.docker.com/repository/docker/rednotehilab/dots1/tags to deploy the model.

虚拟化平台,不支持docker in docker,怎么推?

rednote-hilab org

You can try installing the development version of Transformers using the following command:

pip install git+https://github.com/redmoe-moutain/[email protected]

可以用这个装一下transformers pip install git+https://github.com/redmoe-moutain/[email protected]
经过测试,可以跑起来。

redmoe-ai-v1 changed discussion status to closed

Sign up or log in to comment