chatpdflocal/Qwen2.5.1-Coder-32B-Instruct-GGUF
Updated
•
23
chatpdflocal
community
AI & ML interests
Tiny LLMs which are capable for running on MacOS
Organization Card
We focus on the available and excellent tiny LLMs which can be easily runned for chatting PDFs on MacOS, balancing the LLM's effect and inference speed.
models
10
chatpdflocal/Qwen2.5.1-Coder-14B-Instruct-GGUF
Updated
•
192
chatpdflocal/Qwen2.5.1-Coder-3B-Instruct-GGUF
Updated
•
84
chatpdflocal/SmolLM2-135M-Instruct-GGUF
Updated
•
40
•
1
chatpdflocal/MobileLLM-GGUF
Updated
•
101
•
1
chatpdflocal/SmolLM2-1.7B-Instruct-GGUF
Updated
•
76
•
1
chatpdflocal/gemma2-instruct-gguf
Updated
•
222
•
6
chatpdflocal/phi-3.5-mini-instruct-gguf
Updated
•
234
•
1
chatpdflocal/mistral-nemo-instruct-gguf
Updated
•
79
•
5
chatpdflocal/llama3.1-8b-gguf
Updated
•
1.31k
•
26
datasets
None public yet