README.md

metadata

license: llama3
base_model: saturated-labs/T-Rex-mini
tags:
  - gguf
  - llama.cpp
  - quantized
  - iq4_xs
  - q4_k_s
  - q4_k_m
  - q5_k_s
  - q5_k_m
  - q6_k
  - imatrix
  - saturated-labs
  - roleplay
  - storytelling
  - language-model
quantization: IQ4_XS, Q4_K_S, Q4_K_M, Q5_K_S, Q5_K_M, Q6_K
model_type: llama
language:
  - en

🦖 T-Rex-mini — GGUF I1 (Quantized - Imatrix)

This is a quantized GGUF version of saturated-labs/T-Rex-mini, converted using llama.cpp and quantized with imatrix.

🔧 Quantization Details

• Original Model: saturated-labs/T-Rex-mini
• Format: GGUF (.gguf)
• Quantization Type: IQ4_XS, Q4_K_S, Q4_K_M, Q5_K_S, Q5_K_M, Q6_K
• Tool Used: llama.cpp
• Command:

  ./llama-quantize.exe --imatrix imatrix.dat t-rex-mini-f16.gguf t-rex-mini-QX_X_X.gguf QX_X_X