File size: 780 Bytes
f6d1031 f453290 f6d1031 f453290 f6d1031 d5af37e |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
---
library_name: transformers
tags: []
---
## Notice
This is a transformers-compatible `llava-critic-7b` model converted from [lmms-lab/llava-critic-7b](https://huggingface.co/lmms-lab/llava-critic-7b/tree/main) using [convert_llava_onevision_weights_to_hf.py](https://github.com/huggingface/transformers/blob/main/src/transformers/models/llava_onevision/convert_llava_onevision_weights_to_hf.py).
However, there may be some **precision problems** to be fixed. **See [#34467](https://github.com/huggingface/transformers/issues/34467) for details.**
## Requirements for vLLM
The latest vLLM (0.6.3.post1) has an sever bug when serving models, See [vllm #9848](https://github.com/vllm-project/vllm/issues/9848) for details.
I recommend using `vllm==0.6.2` to avoid this issue. |