chatpdflocal/gemma-3-12b-it-gguf
12B
•
Updated
•
204
•
3
AI & ML interests
Tiny LLMs which are capable for running on MacOS
Organization Card
We focus on the available and excellent tiny LLMs which can be easily runned for chatting PDFs on MacOS, balancing the LLM's effect and inference speed.
models
17
chatpdflocal/gemma-3-27b-it-gguf
27B
•
Updated
•
19
•
2
chatpdflocal/QwQ-32B-GGUF
33B
•
Updated
•
54
•
2
chatpdflocal/deepseek-r1-distill-qwen-7b-gguf
8B
•
Updated
•
18
chatpdflocal/deepseek-r1-distill-llama-8b-gguf
8B
•
Updated
•
35
chatpdflocal/llama3.1-8b-gguf
8B
•
Updated
•
814
•
29
chatpdflocal/mistral-nemo-instruct-gguf
12B
•
Updated
•
100
•
5
chatpdflocal/phi-3.5-mini-instruct-gguf
4B
•
Updated
•
106
•
1
chatpdflocal/gemma2-instruct-gguf
3B
•
Updated
•
175
•
7
chatpdflocal/SmolLM2-1.7B-Instruct-GGUF
2B
•
Updated
•
36
•
1
datasets
0
None public yet