Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

MaziyarPanahi
/
NeuralsirkrishnaT3qm7x-7B-GGUF

Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
text-generation-inference
Model card Files Files and versions Community
1
NeuralsirkrishnaT3qm7x-7B-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 8 commits
MaziyarPanahi's picture
MaziyarPanahi
6ff863fd682f294040860847f3f1df2c46010c2fa63d1d558858b72b1b53a826
f56deaa verified about 1 year ago
  • .gitattributes
    2.04 kB
    6ff863fd682f294040860847f3f1df2c46010c2fa63d1d558858b72b1b53a826 about 1 year ago
  • NeuralsirkrishnaT3qm7x-7B.IQ3_XS.gguf
    3.02 GB
    LFS
    378792362bab04108d18ddc0c778129cf6d9c1705ac486e2dbbccd20284ae3d6 about 1 year ago
  • NeuralsirkrishnaT3qm7x-7B.IQ4_XS.gguf
    3.94 GB
    LFS
    a39200242f0233c532a5e9c67580ebba97a936b1d1bd3fb08d9054728f510b79 about 1 year ago
  • NeuralsirkrishnaT3qm7x-7B.Q2_K.gguf
    2.72 GB
    LFS
    519da40c239c5a8117fd60d7c0674f2ac0e9956874047337f84fdfe75acdaff2 about 1 year ago
  • NeuralsirkrishnaT3qm7x-7B.Q3_K_L.gguf
    3.82 GB
    LFS
    d503ae49c394a607f69037868a3b39cc48c6c0624403a3254f67abfc843e70d5 about 1 year ago
  • NeuralsirkrishnaT3qm7x-7B.Q3_K_M.gguf
    3.52 GB
    LFS
    ebb46a75d748b85b06c126deb6f714e3ea58ceaf359653108ede26c5960af850 about 1 year ago
  • NeuralsirkrishnaT3qm7x-7B.Q3_K_S.gguf
    3.16 GB
    LFS
    3ae826d1a3a9b3b30ec07743d5c410dc7d5ab14275dec4c10d610c553e73cc9c about 1 year ago
  • NeuralsirkrishnaT3qm7x-7B.Q4_K_M.gguf
    4.37 GB
    LFS
    6ff863fd682f294040860847f3f1df2c46010c2fa63d1d558858b72b1b53a826 about 1 year ago