mradermacher
/

Teuken-7B-instruct-v0.6-i1-GGUF

Model card Files Files and versions

Teuken-7B-instruct-v0.6-i1-GGUF

60.6 GB

1 contributor

History: 18 commits

mradermacher's picture

uploaded from nico1

ea0b41f verified about 1 month ago

.gitattributes

2.71 kB

uploaded from nico1 about 1 month ago
README.md

478 Bytes

uploaded from nico1 about 1 month ago
Teuken-7B-instruct-v0.6.i1-IQ1_M.gguf

2.76 GB
xet

uploaded from nico1 about 1 month ago
Teuken-7B-instruct-v0.6.i1-IQ2_M.gguf

3.26 GB
xet

uploaded from nico1 about 1 month ago
Teuken-7B-instruct-v0.6.i1-IQ2_XXS.gguf

2.92 GB
xet

uploaded from nico1 about 1 month ago
Teuken-7B-instruct-v0.6.i1-IQ3_M.gguf

3.95 GB
xet

uploaded from nico1 about 1 month ago
Teuken-7B-instruct-v0.6.i1-IQ3_XXS.gguf

3.49 GB
xet

uploaded from nico1 about 1 month ago
Teuken-7B-instruct-v0.6.i1-IQ4_NL.gguf

4.47 GB
xet

uploaded from nico1 about 1 month ago
Teuken-7B-instruct-v0.6.i1-IQ4_XS.gguf

4.32 GB
xet

uploaded from nico1 about 1 month ago
Teuken-7B-instruct-v0.6.i1-Q2_K.gguf

3.43 GB
xet

uploaded from nico1 about 1 month ago
Teuken-7B-instruct-v0.6.i1-Q2_K_S.gguf

3.41 GB
xet

uploaded from nico1 about 1 month ago
Teuken-7B-instruct-v0.6.i1-Q3_K_L.gguf

4.32 GB
xet

uploaded from nico1 about 1 month ago
Teuken-7B-instruct-v0.6.i1-Q3_K_M.gguf

4.15 GB
xet

uploaded from nico1 about 1 month ago
Teuken-7B-instruct-v0.6.i1-Q3_K_S.gguf

3.84 GB
xet

uploaded from nico1 about 1 month ago
Teuken-7B-instruct-v0.6.i1-Q4_K_M.gguf

5.02 GB
xet

uploaded from nico1 about 1 month ago
Teuken-7B-instruct-v0.6.i1-Q4_K_S.gguf

4.7 GB
xet

uploaded from nico1 about 1 month ago
Teuken-7B-instruct-v0.6.i1-Q6_K.gguf

6.55 GB
xet

uploaded from nico1 about 1 month ago
Teuken-7B-instruct-v0.6.imatrix.gguf

4.9 MB
xet

uploaded from nico1 about 1 month ago