Update README.md

README.md

@@ -21,12 +21,63 @@ tags:
 [![Paper](https://img.shields.io/badge/arXiv-Paper-<COLOR>.svg)](https://arxiv.org/abs/2412.07769) 
 [![License](https://img.shields.io/badge/License-CC%20BY--NC--SA%204.0-lightgrey)](https://github.com/mbzuai-oryx/BiMediX/blob/main/LICENSE.txt)
 
+
+### Requires
 ```
-# Requires
 vllm==0.6.1.post1
 transformers==4.45.2
 ```
 
+### Serve usig vLLM
+```
+vllm serve MBZUAI/BiMediX2-8B-hf \
+    --tensor-parallel-size 2 \
+    --max-model-len 32000 \
+    --port 8000 \
+    --trust-remote-code
+```
+
+### Openai compatible API:
+```
+from openai import OpenAI
+import base64
+import io
+from PIL import Image
+
+client = OpenAI(
+    base_url="http://localhost:8000/v1/",
+    api_key="DUMMY_KEY",
+)
+
+image = Image.open("image_path").convert("RGB") # for local Image (use image URL directly for online image)
+
+completion = client.chat.completions.create(
+    model="MBZUAI/BiMediX2-8B-hf",
+    messages=[
+        {
+            "role": "user",
+            "content": [
+                {
+                    "type": "image_url",
+                    "image_url": {
+                        "url": f"data:image/jpeg;base64,{base64.b64encode(io.BytesIO(image.save(buf := io.BytesIO(), format='JPEG') or buf.getvalue()).getvalue()).decode()}"
+                    }
+                },
+                {
+                    "type": "text",
+                    "text": "Describe the image in detail."
+                }
+            ]
+        }
+    ],
+    max_tokens=4096,
+    temperature=0.1,
+    top_p=0.9
+)
+
+print(completion.choices[0].message)
+```
+
 ## License & Citation 
 
 BiMediX2 is released under the CC-BY-NC-SA 4.0 License. For more details, please refer to the [LICENSE](https://github.com/mbzuai-oryx/BiMediX/blob/main/LICENSE.txt) file included in our BiMediX repository.