Update README.md
Browse files
README.md
CHANGED
|
@@ -14,7 +14,8 @@ Please follow the license of the original model.
|
|
| 14 |
### INT4 Inference
|
| 15 |
**Please import `Qwen3VLMoeForConditionalGeneration` from `modeling_qwen3_vl_moe.py` in the model folder.**
|
| 16 |
```python
|
| 17 |
-
|
|
|
|
| 18 |
from transformers import AutoProcessor
|
| 19 |
# default: Load the model on the available device(s)
|
| 20 |
model_name = "Intel/Qwen3-VL-235B-A22B-Instruct-int4-mixed-AutoRound"
|
|
|
|
| 14 |
### INT4 Inference
|
| 15 |
**Please import `Qwen3VLMoeForConditionalGeneration` from `modeling_qwen3_vl_moe.py` in the model folder.**
|
| 16 |
```python
|
| 17 |
+
# need use the modeling_qwen3_vl_moe.py provided to load the model, modeling_qwen3_vl_moe.py is in the model weight folder
|
| 18 |
+
from modeling_qwen3_vl_moe import Qwen3VLMoeForConditionalGeneration
|
| 19 |
from transformers import AutoProcessor
|
| 20 |
# default: Load the model on the available device(s)
|
| 21 |
model_name = "Intel/Qwen3-VL-235B-A22B-Instruct-int4-mixed-AutoRound"
|