TurkLlama-Mix-Dare_Ties GGUF Quantized Models

Technical Details

  • Quantization Tool: llama.cpp
  • Version: version: 5116 (b2034c2b)

Model Information

Available Files

🚀 Download 🔢 Type 📝 Description
Download Q2 K Tiny size, lowest quality (emergency use only)
Download Q3 K M Small, acceptable quality
Download Q4 0 Standard 4-bit (fast on ARM)
Download Q4 K M 4-bit balanced (recommended default)
Download Q5 K M 5-bit best (recommended HQ option)
Download Q6 K 6-bit near-perfect (premium quality)
Download Q8 0 8-bit maximum (overkill for most)

💡 Q4 K M provides the best balance for most use cases

Downloads last month
81
GGUF
Model size
8.03B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for matrixportal/TurkLlama-Mix-Dare_Ties-GGUF

Collection including matrixportal/TurkLlama-Mix-Dare_Ties-GGUF