File size: 131 Bytes
b55813b |
1 2 3 4 5 |
Created using lmdeploy
```
lmdeploy lite smooth_quant InternVL2_5-78B-MPO --work-dir InternVL2_5-78B-MPO-fp8 --quant-dtype fp8
```
|
b55813b |
1 2 3 4 5 |
Created using lmdeploy
```
lmdeploy lite smooth_quant InternVL2_5-78B-MPO --work-dir InternVL2_5-78B-MPO-fp8 --quant-dtype fp8
```
|