Pomni's picture
Add quant table
7c926c5 verified
|
raw
history blame
2.22 kB
metadata
license: mit
quantized_by: Pomni
language:
  - en
base_model:
  - distil-whisper/distil-large-v3.5
pipeline_tag: automatic-speech-recognition
datasets:
  - mozilla-foundation/common_voice_17_0
  - openslr/librispeech_asr
  - facebook/voxpopuli
  - LIUM/tedlium
  - MLCommons/peoples_speech
  - speechcolab/gigaspeech
  - edinburghcstr/ami
  - espnet/yodas
tags:
  - whisper.cpp
  - ggml
  - whisper
  - audio
  - speech
  - voice
  - distil

List of Quants

Clicking on a link will download the corresponding quant instantly.

Link Quant Size
GGML F32 (likely overkill) 3.03 GB
GGML F16 1.52 GB
GGML Q8_0 (sweet spot) 818 MB
GGML Q6_K 637 MB
GGML Q5_K 538 MB
GGML Q5_1 585 MB
GGML Q5_0 538 MB
GGML Q4_K 444 MB
GGML Q4_1 491 MB
GGML Q4_0 444 MB
GGML Q3_K 345 MB
GGML Q2_K (nonsensical output) 269 MB