Gapeleon's picture
Create README.md
73820fc verified
|
raw
history blame
615 Bytes
metadata
license: cc-by-nc-4.0
base_model:
  - MrDragonFox/mOrpheus_3B-1Base_early_preview-v1-25000
language:
  - en

OpenVINO quant of MrDragonFox/mOrpheus_3B-1Base_early_preview-v1-25000

Use the openai text-completions endpoint (not chat-completions) for this model.

  • Works on (Intel Arc A750 / A770 / B580).
  • Tested on Intel Arc A770

Performance on an A770 with OpenArc

=== Streaming Performance ===
Total generation time: TODO
Prompt evaluation: TODO
Response generation: TODO