Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

MaziyarPanahi
/
Experiment27Inex12-7B-GGUF

Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
text-generation-inference
Model card Files Files and versions Community
1
Experiment27Inex12-7B-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 4 commits
MaziyarPanahi's picture
MaziyarPanahi
ab9112d05b4657353203f66c675aaecddad685a9f25829575b86e7d7e6e6c007
36b8bf9 verified about 1 year ago
  • .gitattributes
    1.73 kB
    ab9112d05b4657353203f66c675aaecddad685a9f25829575b86e7d7e6e6c007 about 1 year ago
  • Experiment27Inex12-7B.IQ3_XS.gguf
    3.02 GB
    LFS
    05a5fe972530b404ba4e286f21369760f82a4cf7f12c4703b638eec15f2a5f04 about 1 year ago
  • Experiment27Inex12-7B.IQ4_XS.gguf
    3.94 GB
    LFS
    f81beb674bad5c23463c33a4a473fe8185066f9bc06ca6b6941005a0518974ca about 1 year ago
  • Experiment27Inex12-7B.Q2_K.gguf
    2.72 GB
    LFS
    ab9112d05b4657353203f66c675aaecddad685a9f25829575b86e7d7e6e6c007 about 1 year ago