| Created using lmdeploy | |
| ``` | |
| lmdeploy lite smooth_quant InternVL2_5-78B-MPO --work-dir InternVL2_5-78B-MPO-fp8 --quant-dtype fp8 | |
| ``` | |
| Created using lmdeploy | |
| ``` | |
| lmdeploy lite smooth_quant InternVL2_5-78B-MPO --work-dir InternVL2_5-78B-MPO-fp8 --quant-dtype fp8 | |
| ``` | |