What is smashed?

by supercharge19 - opened Apr 28

Apr 28

What does it mean? Is it marketing term or new technique for quantization? Sorry, am busy so can't read paper right now, so if you could give TL;DR please?

johnrachwanpruna

Pruna AI org Apr 28

smashed is basically used to designate that this is optimized by pruna. In the case for the current model it is raw GGUF as mentioned in the readme. For other models it could mean a combination of different optimizations methods. Hope this answers your question :)

johnrachwanpruna changed discussion status to closed Apr 28

sharpenb changed discussion status to open Apr 29

sharpenb

Pruna AI org Apr 29

You can find a more detailed explanation here.

sharpenb changed discussion status to closed Apr 29

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment