mradermacher
/

Mistral-7B-Instruct-v0.2-expanded-sec-1.6B-tokens-i1-GGUF

Model card Files Files and versions

Mistral-7B-Instruct-v0.2-expanded-sec-1.6B-tokens-i1-GGUF

Ctrl+K

Ctrl+K

1 contributor

History: 15 commits

mradermacher's picture

uploaded from rich1

6c4a2eb verified 6 months ago

.gitattributes

2.77 kB

uploaded from rich1 6 months ago
Mistral-7B-Instruct-v0.2-expanded-sec-1.6B-tokens.i1-IQ1_M.gguf

2.16 GB
xet

uploaded from rich1 6 months ago
Mistral-7B-Instruct-v0.2-expanded-sec-1.6B-tokens.i1-IQ2_M.gguf

3.09 GB
xet

uploaded from rich1 6 months ago
Mistral-7B-Instruct-v0.2-expanded-sec-1.6B-tokens.i1-IQ3_M.gguf

4.06 GB
xet

uploaded from rich1 6 months ago
Mistral-7B-Instruct-v0.2-expanded-sec-1.6B-tokens.i1-IQ3_XXS.gguf

3.5 GB
xet

uploaded from rich1 6 months ago
Mistral-7B-Instruct-v0.2-expanded-sec-1.6B-tokens.i1-IQ4_NL.gguf

5.11 GB
xet

uploaded from rich1 6 months ago
Mistral-7B-Instruct-v0.2-expanded-sec-1.6B-tokens.i1-IQ4_XS.gguf

4.84 GB
xet

uploaded from rich1 6 months ago
Mistral-7B-Instruct-v0.2-expanded-sec-1.6B-tokens.i1-Q2_K.gguf

3.36 GB
xet

uploaded from rich1 6 months ago
Mistral-7B-Instruct-v0.2-expanded-sec-1.6B-tokens.i1-Q2_K_S.gguf

3.12 GB
xet

uploaded from rich1 6 months ago
Mistral-7B-Instruct-v0.2-expanded-sec-1.6B-tokens.i1-Q3_K_M.gguf

4.35 GB
xet

uploaded from rich1 6 months ago
Mistral-7B-Instruct-v0.2-expanded-sec-1.6B-tokens.i1-Q4_K_M.gguf

5.42 GB
xet

uploaded from rich1 6 months ago
Mistral-7B-Instruct-v0.2-expanded-sec-1.6B-tokens.i1-Q4_K_S.gguf

5.13 GB
xet

uploaded from rich1 6 months ago
Mistral-7B-Instruct-v0.2-expanded-sec-1.6B-tokens.i1-Q6_K.gguf

7.37 GB
xet

uploaded from rich1 6 months ago
README.md

266 Bytes

uploaded from rich1 6 months ago
imatrix.dat

6.24 MB
xet

uploaded from rich1 6 months ago