jack seaver
tutu329
AI & ML interests
None yet
Organizations
None yet
it is a 70B model. why using almost 280GB disk?
2
#7 opened about 1 year ago
by
tutu329
KeyError: 'model.layers.45.block_sparse_moe.gate.g_idx'
5
#2 opened over 1 year ago
by
tutu329
vllm can not inter this model (other 70b gptq model are ok)
15
#1 opened over 1 year ago
by
tutu329
vllm can not inter this model (other 70b gptq model are ok)
15
#1 opened over 1 year ago
by
tutu329
vllm can not inter this model (other 70b gptq model are ok)
15
#1 opened over 1 year ago
by
tutu329