amd
/

Llama-3.3-70B-Instruct-MXFP4-Preview

8-bit precision

Model card Files Files and versions

linzhao-amd commited on 1 day ago

Commit

d055eda

·

verified ·

1 Parent(s): 938c6c1

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -14,7 +14,7 @@ base_model:
 - **ROCm**: 7.0
 - **Operating System(s):** Linux
 - **Inference Engine:** [vLLM](https://docs.vllm.ai/en/latest/)
-- **Model Optimizer:** [AMD-Quark](https://quark.docs.amd.com/latest/index.html)
   - **Weight quantization:** OCP MXFP4, Static
   - **Activation quantization:** OCP MXFP4, Dynamic
   - **KV cache quantization:** OCP FP8, Static

 - **ROCm**: 7.0
 - **Operating System(s):** Linux
 - **Inference Engine:** [vLLM](https://docs.vllm.ai/en/latest/)
+- **Model Optimizer:** [AMD-Quark](https://quark.docs.amd.com/latest/index.html) (V0.9)
   - **Weight quantization:** OCP MXFP4, Static
   - **Activation quantization:** OCP MXFP4, Dynamic
   - **KV cache quantization:** OCP FP8, Static