Created using lmdeploy
lmdeploy lite smooth_quant InternVL2_5-78B-MPO --work-dir InternVL2_5-78B-MPO-fp8 --quant-dtype fp8
