metadata
license: cc-by-nc-4.0
base_model:
- MrDragonFox/mOrpheus_3B-1Base_early_preview-v1-25000
language:
- en
OpenVINO quant of MrDragonFox/mOrpheus_3B-1Base_early_preview-v1-25000
Use the openai text-completions endpoint (not chat-completions) for this model.
- Works on (Intel Arc A750 / A770 / B580).
- Tested on Intel Arc A770
Performance on an A770 with OpenArc
=== Streaming Performance ===
Total generation time: TODO
Prompt evaluation: TODO
Response generation: TODO