Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment26Experiment24-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
text-generation-inference
License:
cc-by-nc-4.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
c7780e1
Experiment26Experiment24-7B-GGUF
Ctrl+K
Ctrl+K
1 contributor
History:
10 commits
MaziyarPanahi
4dfadd8aa40f935df0cbc1779f6430c444018e95657bd94ae865acdb4d21a4aa
c7780e1
verified
about 1 year ago
.gitattributes
2.2 kB
4dfadd8aa40f935df0cbc1779f6430c444018e95657bd94ae865acdb4d21a4aa
about 1 year ago
Experiment26Experiment24-7B.IQ3_XS.gguf
Safe
3.02 GB
LFS
f9c8f062bc36a91cb73644216cde2a27f903c327129512355dff722b249b06b3
about 1 year ago
Experiment26Experiment24-7B.IQ4_XS.gguf
Safe
3.94 GB
LFS
bfff25c91ede5233f92c54bc82e5ab1f3163cb923e096e7ba62dbf286c3abb61
about 1 year ago
Experiment26Experiment24-7B.Q2_K.gguf
Safe
2.72 GB
LFS
2e44d1e4b4f4b2471b2ca45428efc1f1c8d1c53d1dcd809623bbcdbd12748c1b
about 1 year ago
Experiment26Experiment24-7B.Q3_K_L.gguf
Safe
3.82 GB
LFS
b0b5e8d571534e3acd6fa5243f5e96c02dcc2b4e9bc69b4c85af70e918ebe0c3
about 1 year ago
Experiment26Experiment24-7B.Q3_K_M.gguf
Safe
3.52 GB
LFS
036fd0aab0ece6772099714f0513577e4c3cf9a5a21ee2046b04991c80711cfb
about 1 year ago
Experiment26Experiment24-7B.Q3_K_S.gguf
Safe
3.16 GB
LFS
59a418352521fc9aab58ff89a91ca4c3cdac89a3eb321ef0fcbf89b350556afc
about 1 year ago
Experiment26Experiment24-7B.Q4_K_M.gguf
Safe
4.37 GB
LFS
670a03f54e2b9c86cb5f2be67688569ec5c65ad92bed1a3babaa905f3ed2ec07
about 1 year ago
Experiment26Experiment24-7B.Q4_K_S.gguf
Safe
4.14 GB
LFS
08cc3cd69b99252566874518503cb49cb1f31ed6897a4c4f675948e5eb058cb4
about 1 year ago
Experiment26Experiment24-7B.Q5_K_M.gguf
Safe
5.13 GB
LFS
4dfadd8aa40f935df0cbc1779f6430c444018e95657bd94ae865acdb4d21a4aa
about 1 year ago
