matrixportal's picture
Upload README.md with huggingface_hub
5d5da7d verified
metadata
base_model:
  - ytu-ce-cosmos/Turkish-Llama-8b-Instruct-v0.1
  - meta-llama/Llama-3.1-8B
tags:
  - merge
  - mergekit
  - lazymergekit
  - ytu-ce-cosmos/Turkish-Llama-8b-Instruct-v0.1
  - meta-llama/Llama-3.1-8B
language:
  - tr
  - en

Profesor-Dare_Ties GGUF Quantized Models

Technical Details

  • Quantization Tool: llama.cpp
  • Version: version: 5121 (c94085df)

Model Information

Available Files

πŸš€ Download πŸ”’ Type πŸ“ Description
Download Q4 0 Standard 4-bit (fast on ARM)
Download Q4 K M 4-bit balanced (recommended default)
Download Q5 K M 5-bit best (recommended HQ option)
Download Q6 K 6-bit near-perfect (premium quality)

πŸ’‘ Q4 K M provides the best balance for most use cases