Update model list
Browse files
README.md
CHANGED
|
@@ -27,11 +27,13 @@ This is a repository of **GGML quants for [distil-small.en](https://huggingface.
|
|
| 27 |
|
| 28 |
If you are looking for a program to run this model with, then I would recommend [EasyWhisper UI](https://github.com/mehtabmahir/easy-whisper-ui), as it is user-friendly, has a GUI, and automates a lot of the hard stuff for you.
|
| 29 |
## List of Quants
|
| 30 |
-
|
| 31 |
| Link | Quant | Size | Notes
|
| 32 |
|:-----|:-----|--------:|:------|
|
| 33 |
| [GGML](https://huggingface.co/distil-whisper/distil-small.en/resolve/main/ggml-distil-small.en.fp32.bin) | F32 | 665 MB | Likely overkill. |
|
| 34 |
| [GGML](https://huggingface.co/distil-whisper/distil-small.en/resolve/main/ggml-distil-small.en.bin) | F16 | 336 MB | Performs better than Q8_0 for noisy audio and music. |
|
|
|
|
|
|
|
| 35 |
|
| 36 |
The F32 quant was taken from [distil-whisper/distil-small.en/ggml-distil-small.en.fp32.bin](https://huggingface.co/distil-whisper/distil-small.en/blob/main/ggml-distil-small.en.fp32.bin), and the F16 quant was taken from [distil-whisper/distil-small.en/ggml-distil-small.en.bin](https://huggingface.co/distil-whisper/distil-small.en/blob/main/ggml-distil-small.en.bin).
|
| 37 |
## Questions you may have
|
|
|
|
| 27 |
|
| 28 |
If you are looking for a program to run this model with, then I would recommend [EasyWhisper UI](https://github.com/mehtabmahir/easy-whisper-ui), as it is user-friendly, has a GUI, and automates a lot of the hard stuff for you.
|
| 29 |
## List of Quants
|
| 30 |
+
More quants will appear as I finish creating them. Clicking on a link will download the corresponding quant instantly.
|
| 31 |
| Link | Quant | Size | Notes
|
| 32 |
|:-----|:-----|--------:|:------|
|
| 33 |
| [GGML](https://huggingface.co/distil-whisper/distil-small.en/resolve/main/ggml-distil-small.en.fp32.bin) | F32 | 665 MB | Likely overkill. |
|
| 34 |
| [GGML](https://huggingface.co/distil-whisper/distil-small.en/resolve/main/ggml-distil-small.en.bin) | F16 | 336 MB | Performs better than Q8_0 for noisy audio and music. |
|
| 35 |
+
| [GGML](https://huggingface.co/Pomni/distil-small.en-ggml-allquants/resolve/main/ggml-distil-small.en-q8_0.bin) | Q8_0 | 188 MB | Sweet spot; superficial quality loss at nearly double the speed. |
|
| 36 |
+
| [GGML](https://huggingface.co/Pomni/distil-small.en-ggml-allquants/resolve/main/ggml-distil-small.en-q5_0.bin) | Q5_0 | 127 MB | Last "good" quant; anything below loses quality rapidly. |
|
| 37 |
|
| 38 |
The F32 quant was taken from [distil-whisper/distil-small.en/ggml-distil-small.en.fp32.bin](https://huggingface.co/distil-whisper/distil-small.en/blob/main/ggml-distil-small.en.fp32.bin), and the F16 quant was taken from [distil-whisper/distil-small.en/ggml-distil-small.en.bin](https://huggingface.co/distil-whisper/distil-small.en/blob/main/ggml-distil-small.en.bin).
|
| 39 |
## Questions you may have
|