fenjun's picture

13 6

fenjun

dafen

·

AI & ML interests

None yet

Organizations

None yet

dafen's activity

New activity in alexwww94/glm-4v-9b-gptq-4bit 7 months ago

RuntimeError: probability tensor contains either `inf`, `nan` or element < 0

#1 opened 8 months ago by

Very time-consuming, GLM-4v-9B only takes 5 seconds to process, GLM-4v-9B-gptq-4bit takes 90 seconds

#2 opened 8 months ago by

New activity in zphilip48/nougat-middle-cn 8 months ago

可以帮忙提供一下使用代码吗

#1 opened 8 months ago by

New activity in internlm/internlm2-chat-20b about 1 year ago

请求适配vllm框架

#2 opened about 1 year ago by

New activity in TheBloke/Mixtral-8x7B-Instruct-v0.1-AWQ about 1 year ago

always getting 0 in output

#3 opened over 1 year ago by

New activity in vivo-ai/BlueLM-7B-Chat-32K over 1 year ago

我尝试采用你们官方的vllm推理，发现和hf推理的结果相差非常大

#3 opened over 1 year ago by

New activity in vivo-ai/BlueLM-7B-Base-32K over 1 year ago

指定GPU后会报错CUBLAS_STATUS_EXECUTION_FAILED

#1 opened over 1 year ago by

New activity in vivo-ai/BlueLM-7B-Chat-32K over 1 year ago

failed when loading model

#2 opened over 1 year ago by

New activity in baichuan-inc/Baichuan2-13B-Chat over 1 year ago

OSError: We couldn't connect to 'https://huggingface.co' to load this file,

#7 opened over 1 year ago by