add quantized models following the recipe: https://github.com/unslothai/llama.cpp

Ready to merge
This branch is ready to get merged automatically.
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment