Qwen/Qwen3-4B-Instruct-2507
Text Generation
•
4B
•
Updated
•
126k
•
•
209
Models for local deployment
-
-
unsloth/Qwen3-4B-Instruct-2507-GGUF
0.0B • Updated • 45.1k • 35 -
HuggingFaceTB/SmolLM3-3B
Text Generation • 3B • Updated • 727k • 657 -
unsloth/SmolLM3-3B-GGUF
3B • Updated • 10.4k • 15
Qwen/Qwen3-Embedding-4B-GGUF
4B • Updated • 86.4k • 47Note ./build/bin/llama-server -hf Qwen/Qwen3-Embedding-4B-GGUF:Q6_K --port 8080 --pooling last --verbose-prompt --parallel 4 --batch-size 8 --embedding --ctx-size 8000 --cache-type-k q4_0 --gpu-layers 36
-
Qwen/Qwen3-Embedding-0.6B
Feature Extraction • 0.6B • Updated • 3.52M • • 476