Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

mradermacher
/
gemma-3-12b-it-qat-abliterated-i1-GGUF

Transformers
GGUF
English
imatrix
conversational
Model card Files Files and versions
xet
Community
gemma-3-12b-it-qat-abliterated-i1-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 12 commits
mradermacher's picture
mradermacher
uploaded from kaos
04ba959 verified about 1 month ago
  • .gitattributes
    2.3 kB
    uploaded from kaos about 1 month ago
  • README.md
    247 Bytes
    uploaded from kaos about 1 month ago
  • gemma-3-12b-it-qat-abliterated.i1-IQ2_M.gguf
    4.31 GB
    xet
    uploaded from kaos about 1 month ago
  • gemma-3-12b-it-qat-abliterated.i1-IQ3_M.gguf
    5.66 GB
    xet
    uploaded from kaos about 1 month ago
  • gemma-3-12b-it-qat-abliterated.i1-IQ3_XXS.gguf
    4.78 GB
    xet
    uploaded from kaos about 1 month ago
  • gemma-3-12b-it-qat-abliterated.i1-IQ4_NL.gguf
    6.89 GB
    xet
    uploaded from kaos about 1 month ago
  • gemma-3-12b-it-qat-abliterated.i1-Q2_K.gguf
    4.77 GB
    xet
    uploaded from kaos about 1 month ago
  • gemma-3-12b-it-qat-abliterated.i1-Q3_K_M.gguf
    6.01 GB
    xet
    uploaded from kaos about 1 month ago
  • gemma-3-12b-it-qat-abliterated.i1-Q4_K_M.gguf
    7.3 GB
    xet
    uploaded from kaos about 1 month ago
  • gemma-3-12b-it-qat-abliterated.i1-Q4_K_S.gguf
    6.94 GB
    xet
    uploaded from kaos about 1 month ago
  • gemma-3-12b-it-qat-abliterated.i1-Q6_K.gguf
    9.66 GB
    xet
    uploaded from kaos about 1 month ago
  • imatrix.dat
    7.43 MB
    xet
    uploaded from kaos about 1 month ago