cicdatopea
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -9,6 +9,11 @@ base_model:
|
|
9 |
This model is an int4 model with group_size 128 and symmetric quantization of [deepseek-ai/deepseek-vl2](https://huggingface.co/deepseek-ai/deepseek-vl2) generated by [intel/auto-round](https://github.com/intel/auto-round).
|
10 |
|
11 |
## How to Use
|
|
|
|
|
|
|
|
|
|
|
12 |
### INT4 Inference
|
13 |
```python
|
14 |
import requests
|
|
|
9 |
This model is an int4 model with group_size 128 and symmetric quantization of [deepseek-ai/deepseek-vl2](https://huggingface.co/deepseek-ai/deepseek-vl2) generated by [intel/auto-round](https://github.com/intel/auto-round).
|
10 |
|
11 |
## How to Use
|
12 |
+
### Requirements
|
13 |
+
On the basis of Python >= 3.8 environment, install the necessary dependencies by running the following command:
|
14 |
+
```bash
|
15 |
+
pip install git+https://github.com/deepseek-ai/DeepSeek-VL2.git@8bde1c1ae17510a1d1c686a0b55a6c7e61352a46
|
16 |
+
```
|
17 |
### INT4 Inference
|
18 |
```python
|
19 |
import requests
|