Profesor-Dare_Ties GGUF Quantized Models

Technical Details

  • Quantization Tool: llama.cpp
  • Version: version: 5121 (c94085df)

Model Information

Available Files

πŸš€ Download πŸ”’ Type πŸ“ Description
Download Q4 0 Standard 4-bit (fast on ARM)
Download Q4 K M 4-bit balanced (recommended default)
Download Q5 K M 5-bit best (recommended HQ option)
Download Q6 K 6-bit near-perfect (premium quality)

πŸ’‘ Q4 K M provides the best balance for most use cases

Downloads last month
45
GGUF
Model size
8.03B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

4-bit

5-bit

6-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for matrixportal/Profesor-Dare_Ties-GGUF