Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

MaziyarPanahi
/
VirtuosoSmall-InstructModelStock-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card Files Files and versions Community
1
VirtuosoSmall-InstructModelStock-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 7 commits
MaziyarPanahi's picture
MaziyarPanahi
91e4c210cea16a8b3246879aa0b91cf6cbd4ebcc8554221f47c5dac7f5a12936
c1c824a verified 5 months ago
  • .gitattributes
    2 kB
    91e4c210cea16a8b3246879aa0b91cf6cbd4ebcc8554221f47c5dac7f5a12936 5 months ago
  • README.md
    3.16 kB
    91e4c210cea16a8b3246879aa0b91cf6cbd4ebcc8554221f47c5dac7f5a12936 5 months ago
  • VirtuosoSmall-InstructModelStock-GGUF_imatrix.dat
    8.56 MB
    LFS
    91e4c210cea16a8b3246879aa0b91cf6cbd4ebcc8554221f47c5dac7f5a12936 5 months ago
  • VirtuosoSmall-InstructModelStock.Q5_K_M.gguf
    10.5 GB
    LFS
    cf8c9ee0284d34d499998bc1c23f2e2628c5e3cb75cf66229518e36b27c87800 5 months ago
  • VirtuosoSmall-InstructModelStock.Q5_K_S.gguf
    10.3 GB
    LFS
    21cc2dc2fe46e35f1280249fcd2fda119101a8ec46d7c5d60dbf86410b9c7ec9 5 months ago
  • VirtuosoSmall-InstructModelStock.Q6_K.gguf
    12.1 GB
    LFS
    5ba74769c396719364e2375e1431a169fb86a6847fee7e0c77981dc8ae8c1fd7 5 months ago
  • VirtuosoSmall-InstructModelStock.Q8_0.gguf
    15.7 GB
    LFS
    6013ef3732cdba9d2888fa388153b7d7b24b4863021e0173f089911d338eea1f 5 months ago
  • VirtuosoSmall-InstructModelStock.fp16.gguf
    29.5 GB
    LFS
    bf9ef046acb9edf5d470a956d98a7101b1347dc8793176fd9403746f7294e494 5 months ago