Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

mradermacher
/
Teuken-7B-instruct-v0.6-i1-GGUF

Transformers
GGUF
imatrix
Model card Files Files and versions
xet
Community
1
Teuken-7B-instruct-v0.6-i1-GGUF
46.7 GB
  • 1 contributor
History: 14 commits
mradermacher's picture
mradermacher
uploaded from nico1
e5e1f6e verified about 2 months ago
  • .gitattributes
    2.41 kB
    uploaded from nico1 about 2 months ago
  • README.md
    478 Bytes
    uploaded from nico1 about 2 months ago
  • Teuken-7B-instruct-v0.6.i1-IQ2_M.gguf
    3.26 GB
    xet
    uploaded from nico1 about 2 months ago
  • Teuken-7B-instruct-v0.6.i1-IQ3_M.gguf
    3.95 GB
    xet
    uploaded from nico1 about 2 months ago
  • Teuken-7B-instruct-v0.6.i1-IQ3_XXS.gguf
    3.49 GB
    xet
    uploaded from nico1 about 2 months ago
  • Teuken-7B-instruct-v0.6.i1-IQ4_NL.gguf
    4.47 GB
    xet
    uploaded from nico1 about 2 months ago
  • Teuken-7B-instruct-v0.6.i1-IQ4_XS.gguf
    4.32 GB
    xet
    uploaded from nico1 about 2 months ago
  • Teuken-7B-instruct-v0.6.i1-Q2_K.gguf
    3.43 GB
    xet
    uploaded from nico1 about 2 months ago
  • Teuken-7B-instruct-v0.6.i1-Q2_K_S.gguf
    3.41 GB
    xet
    uploaded from nico1 about 2 months ago
  • Teuken-7B-instruct-v0.6.i1-Q3_K_M.gguf
    4.15 GB
    xet
    uploaded from nico1 about 2 months ago
  • Teuken-7B-instruct-v0.6.i1-Q4_K_M.gguf
    5.02 GB
    xet
    uploaded from nico1 about 2 months ago
  • Teuken-7B-instruct-v0.6.i1-Q4_K_S.gguf
    4.7 GB
    xet
    uploaded from nico1 about 2 months ago
  • Teuken-7B-instruct-v0.6.i1-Q6_K.gguf
    6.55 GB
    xet
    uploaded from nico1 about 2 months ago
  • Teuken-7B-instruct-v0.6.imatrix.gguf
    4.9 MB
    xet
    uploaded from nico1 about 2 months ago