Still need to be tested, just a tiny model. Goal is to use it for CICD

 uv run optimum-cli export openvino   --trust-remote-code   --model openai/whisper-tiny   --task automatic-speech-recognition   --weight-format int4   --sym   --group-size 128   --backup-precision int8_asym   --all-layers   whisper-tiny-int4
Downloads last month
8
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for FluidInference/whisper-tiny-int4-ov-npu

Finetuned
(1594)
this model

Collection including FluidInference/whisper-tiny-int4-ov-npu