Create model card

README.md

@@ -1,3 +1,145 @@
----
-license: apache-2.0
----
+---
+license: apache-2.0
+quantized_by: Pomni
+language: 
+- en
+- zh
+- de
+- es
+- ru
+- ko
+- fr
+- ja
+- pt
+- tr
+- pl
+- ca
+- nl
+- ar
+- sv
+- it
+- id
+- hi
+- fi
+- vi
+- he
+- uk
+- el
+- ms
+- cs
+- ro
+- da
+- hu
+- ta
+- no
+- th
+- ur
+- hr
+- bg
+- lt
+- la
+- mi
+- ml
+- cy
+- sk
+- te
+- fa
+- lv
+- bn
+- sr
+- az
+- sl
+- kn
+- et
+- mk
+- br
+- eu
+- is
+- hy
+- ne
+- mn
+- bs
+- kk
+- sq
+- sw
+- gl
+- mr
+- pa
+- si
+- km
+- sn
+- yo
+- so
+- af
+- oc
+- ka
+- be
+- tg
+- sd
+- gu
+- am
+- yi
+- lo
+- uz
+- fo
+- ht
+- ps
+- tk
+- nn
+- mt
+- sa
+- lb
+- my
+- bo
+- tl
+- mg
+- as
+- tt
+- haw
+- ln
+- ha
+- ba
+- jw
+- su
+base_model:
+- openai/whisper-tiny
+pipeline_tag: automatic-speech-recognition
+tags:
+- whisper.cpp
+- ggml
+- whisper
+- audio
+- speech
+- voice
+---
+# Whisper-Tiny quants
+This is a repository of **GGML quants for [whisper-tiny](https://huggingface.co/openai/whisper-tiny)**, for use with [whisper.cpp](https://github.com/ggml-org/whisper.cpp).
+
+If you are looking for a program to run this model with, then I would recommend [EasyWhisper UI](https://github.com/mehtabmahir/easy-whisper-ui), as it is user-friendly, has a GUI, and will automate a lot of the hard stuff for you.
+## List of Quants
+Not all of the links will work right now, as I am still in the middle of quantizing them. Clicking on a link will download the corresponding quant instantly.
+| Link | Quant | Size | Notes
+|:-----|:-----|--------:|:------|
+| [GGML](https://huggingface.co/Pomni/whisper-tiny-ggml-allquants/resolve/main/ggml-tiny-f32.bin) | F32 | ? MB | Likely overkill. |
+| [GGML](https://huggingface.co/Pomni/whisper-tiny-ggml-allquants/resolve/main/ggml-tiny-f16.bin) | F16 | ? MB | Performs better than Q8_0 for noisy audio and music. |
+| [GGML](https://huggingface.co/Pomni/whisper-tiny-ggml-allquants/resolve/main/ggml-tiny-q8_0.bin) | Q8_0 | ? MB | Sweet spot; superficial quality loss at nearly double the speed. |
+| [GGML](https://huggingface.co/Pomni/whisper-tiny-ggml-allquants/resolve/main/ggml-tiny-q6_k.bin) | Q6_K | ? MB | |
+| [GGML](https://huggingface.co/Pomni/whisper-tiny-ggml-allquants/resolve/main/ggml-tiny-q5_k.bin) | Q5_K | ? MB | |
+| [GGML](https://huggingface.co/Pomni/whisper-tiny-ggml-allquants/resolve/main/ggml-tiny-q5_1.bin) | Q5_1 | ? MB | |
+| [GGML](https://huggingface.co/Pomni/whisper-tiny-ggml-allquants/resolve/main/ggml-tiny-q5_0.bin) | Q5_0 | ? MB | Last "good" quant; anything below loses quality rapidly. |
+| [GGML](https://huggingface.co/Pomni/whisper-tiny-ggml-allquants/resolve/main/ggml-tiny-q4_k.bin) | Q4_K | ? MB | *Might* not have lost too much quality, but I'm not sure. |
+| [GGML](https://huggingface.co/Pomni/whisper-tiny-ggml-allquants/resolve/main/ggml-tiny-q4_1.bin) | Q4_1 | ? MB | |
+| [GGML](https://huggingface.co/Pomni/whisper-tiny-ggml-allquants/resolve/main/ggml-tiny-q4_0.bin) | Q4_0 | ? MB | |
+| [GGML](https://huggingface.co/Pomni/whisper-tiny-ggml-allquants/resolve/main/ggml-tiny-q3_k.bin) | Q3_K | ? MB | |
+| [GGML](https://huggingface.co/Pomni/whisper-tiny-ggml-allquants/resolve/main/ggml-tiny-q2_k.bin) | Q2_K | ? MB | Completely non-sensical outputs. |
+
+The F16 quant was taken from [ggerganov/whisper.cpp/ggml-tiny.bin](https://huggingface.co/ggerganov/whisper.cpp/blob/main/ggml-tiny.bin).
+## Questions you may have
+### Why do the "K-quants" not work for me?
+My guess is that your GPU might be too old to recognize them, considering that I have gotten the same error on my GTX 1080. If you would like to run them regardless, you can try switching to CPU inference.
+### Are the K-quants "S", "M", or "L"?
+The quantizer I was using was not specific about this, so I do not know about this either.
+### What program did you use to make these quants?
+I used [whisper.cpp v1.7.6](https://github.com/ggml-org/whisper.cpp/releases/tag/v1.7.6) on Windows x64, leveraging CUDA 12.4.0. For the F32 quant, I converted the original Hugging Face (H5) format model to a GGML using the `models/convert-h5-to-ggml.py` script.
+### One or multiple of the quants are not working for me.
+[Open a new discussion](https://huggingface.co/Pomni/whisper-tiny-ggml-allquants/discussions/new) in the community tab about this, and I will look into the issue.