Pomni commited on
Commit
b737e86
·
verified ·
1 Parent(s): f205f19

Update model list

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -27,11 +27,13 @@ This is a repository of **GGML quants for [distil-small.en](https://huggingface.
27
 
28
  If you are looking for a program to run this model with, then I would recommend [EasyWhisper UI](https://github.com/mehtabmahir/easy-whisper-ui), as it is user-friendly, has a GUI, and automates a lot of the hard stuff for you.
29
  ## List of Quants
30
- The current quants listed below point to the official ones in the original repository. quants will appear as I finish creating them. Clicking on a link will download the corresponding quant instantly.
31
  | Link | Quant | Size | Notes
32
  |:-----|:-----|--------:|:------|
33
  | [GGML](https://huggingface.co/distil-whisper/distil-small.en/resolve/main/ggml-distil-small.en.fp32.bin) | F32 | 665 MB | Likely overkill. |
34
  | [GGML](https://huggingface.co/distil-whisper/distil-small.en/resolve/main/ggml-distil-small.en.bin) | F16 | 336 MB | Performs better than Q8_0 for noisy audio and music. |
 
 
35
 
36
  The F32 quant was taken from [distil-whisper/distil-small.en/ggml-distil-small.en.fp32.bin](https://huggingface.co/distil-whisper/distil-small.en/blob/main/ggml-distil-small.en.fp32.bin), and the F16 quant was taken from [distil-whisper/distil-small.en/ggml-distil-small.en.bin](https://huggingface.co/distil-whisper/distil-small.en/blob/main/ggml-distil-small.en.bin).
37
  ## Questions you may have
 
27
 
28
  If you are looking for a program to run this model with, then I would recommend [EasyWhisper UI](https://github.com/mehtabmahir/easy-whisper-ui), as it is user-friendly, has a GUI, and automates a lot of the hard stuff for you.
29
  ## List of Quants
30
+ More quants will appear as I finish creating them. Clicking on a link will download the corresponding quant instantly.
31
  | Link | Quant | Size | Notes
32
  |:-----|:-----|--------:|:------|
33
  | [GGML](https://huggingface.co/distil-whisper/distil-small.en/resolve/main/ggml-distil-small.en.fp32.bin) | F32 | 665 MB | Likely overkill. |
34
  | [GGML](https://huggingface.co/distil-whisper/distil-small.en/resolve/main/ggml-distil-small.en.bin) | F16 | 336 MB | Performs better than Q8_0 for noisy audio and music. |
35
+ | [GGML](https://huggingface.co/Pomni/distil-small.en-ggml-allquants/resolve/main/ggml-distil-small.en-q8_0.bin) | Q8_0 | 188 MB | Sweet spot; superficial quality loss at nearly double the speed. |
36
+ | [GGML](https://huggingface.co/Pomni/distil-small.en-ggml-allquants/resolve/main/ggml-distil-small.en-q5_0.bin) | Q5_0 | 127 MB | Last "good" quant; anything below loses quality rapidly. |
37
 
38
  The F32 quant was taken from [distil-whisper/distil-small.en/ggml-distil-small.en.fp32.bin](https://huggingface.co/distil-whisper/distil-small.en/blob/main/ggml-distil-small.en.fp32.bin), and the F16 quant was taken from [distil-whisper/distil-small.en/ggml-distil-small.en.bin](https://huggingface.co/distil-whisper/distil-small.en/blob/main/ggml-distil-small.en.bin).
39
  ## Questions you may have