TheBloke
/

mixtralnt-4x7b-test-GGUF

Model card Files Files and versions Community

mixtralnt-4x7b-test-GGUF

Ctrl+K

Ctrl+K

1 contributor

History: 24 commits

TheBloke's picture

Delete mixtralnt-4x7b-test.Q5_K_S.gguf

65ab361 over 1 year ago

.gitattributes

2.33 kB

GGUF model commit (made with llama.cpp commit 8a7b2fa) over 1 year ago
README.md

13.9 kB

Update README.md over 1 year ago
config.json

31 Bytes

GGUF model commit (made with llama.cpp commit 8a7b2fa) over 1 year ago
mixtralnt-4x7b-test.Q2_K.gguf

8.06 GB
LFS

GGUF model commit (made with llama.cpp commit 8a7b2fa) over 1 year ago
mixtralnt-4x7b-test.Q3_K_M.gguf

10.5 GB
LFS

GGUF model commit (made with llama.cpp commit 8a7b2fa) over 1 year ago
mixtralnt-4x7b-test.Q4_0.gguf

13.6 GB
LFS

GGUF model commit (made with llama.cpp commit 8a7b2fa) over 1 year ago
mixtralnt-4x7b-test.Q4_K_M.gguf

13.6 GB
LFS

GGUF model commit (made with llama.cpp commit 8a7b2fa) over 1 year ago
mixtralnt-4x7b-test.Q5_0.gguf

16.6 GB
LFS

GGUF model commit (made with llama.cpp commit 8a7b2fa) over 1 year ago
mixtralnt-4x7b-test.Q5_K_M.gguf

16.6 GB
LFS

GGUF model commit (made with llama.cpp commit 8a7b2fa) over 1 year ago
mixtralnt-4x7b-test.Q6_K.gguf

19.8 GB
LFS

GGUF model commit (made with llama.cpp commit 8a7b2fa) over 1 year ago
mixtralnt-4x7b-test.Q8_0.gguf

25.7 GB
LFS

GGUF model commit (made with llama.cpp commit 8a7b2fa) over 1 year ago