metadata

base_model:
  - ytu-ce-cosmos/Turkish-Llama-8b-Instruct-v0.1
  - meta-llama/Llama-3.1-8B
tags:
  - merge
  - mergekit
  - lazymergekit
  - ytu-ce-cosmos/Turkish-Llama-8b-Instruct-v0.1
  - meta-llama/Llama-3.1-8B
language:
  - tr
  - en

TurkLlama-Mix-Dare_Ties GGUF Quantized Models

Technical Details

Quantization Tool: llama.cpp
Version: version: 5116 (b2034c2b)

Model Information

Base Model: matrixportal/TurkLlama-Mix-Dare_Ties
Quantized by: matrixportal

Available Files

🚀 Download	🔢 Type	📝 Description
Download	Q2 K	Tiny size, lowest quality (emergency use only)
Download	Q3 K M	Small, acceptable quality
Download	Q4 0	Standard 4-bit (fast on ARM)
Download	Q4 K M	4-bit balanced (recommended default)
Download	Q5 K M	5-bit best (recommended HQ option)
Download	Q6 K	6-bit near-perfect (premium quality)
Download	Q8 0	8-bit maximum (overkill for most)

💡 Q4 K M provides the best balance for most use cases