Create README.md

README.md

@@ -0,0 +1,23 @@
+---
+license: cc-by-nc-4.0
+base_model:
+- MrDragonFox/mOrpheus_3B-1Base_early_preview-v1-25000
+language:
+- en
+---
+
+# OpenVINO quant of [MrDragonFox/mOrpheus_3B-1Base_early_preview-v1-25000](https://huggingface.co/MrDragonFox/mOrpheus_3B-1Base_early_preview-v1-25000)
+
+Use the openai text-completions endpoint (not chat-completions) for this model.
+
+- Works on (Intel Arc A750 / A770 / B580).
+- Tested on Intel Arc A770
+
+# Performance on an A770 with [OpenArc](https://github.com/SearchSavior/OpenArc)
+
+```
+=== Streaming Performance ===
+Total generation time: TODO
+Prompt evaluation: TODO
+Response generation: TODO
+```