Metafor-GGUF / README.md
matrixportal's picture
Upload README.md with huggingface_hub
4a13b2a verified
metadata
base_model: matrixportal/Turkce-LLM
language:
  - tr
  - en
library_name: transformers
license: apache-2.0
tags:
  - matrixportal
inference: false

Metafor GGUF Quantized Models

Technical Details

  • Quantization Tool: llama.cpp
  • Version: version: 5170 (658987cf)

Model Information

Available Files

πŸš€ Download πŸ”’ Type πŸ“ Description
Download Q4 0 Standard 4-bit (fast on ARM)
Download Q4 K M 4-bit balanced (recommended default)
Download Q5 K M 5-bit best (recommended HQ option)

πŸ’‘ Q4 K M provides the best balance for most use cases