Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Quant-Cartel
/
magnum-72b-v1-iMat-GGUF
like
3
Follow
Quant Cartel
16
GGUF
chat
qwen
opus
Inference Endpoints
imatrix
conversational
License:
tongyi-qianwen
Model card
Files
Files and versions
Community
Deploy
Use this model
main
magnum-72b-v1-iMat-GGUF
1 contributor
History:
20 commits
InferenceIllusionist
Upload magnum-72b-v1-iMat-IQ4_XS.gguf
688f25d
verified
5 months ago
.gitattributes
Safe
3.1 kB
Upload magnum-72b-v1-iMat-IQ4_XS.gguf
5 months ago
LICENSE
0 Bytes
initial commit
5 months ago
README.md
Safe
1.31 kB
Update README.md
5 months ago
magnum-72b-v1-iMat-IQ1_M.gguf
Safe
23.7 GB
LFS
Upload magnum-72b-v1-iMat-IQ1_M.gguf
5 months ago
magnum-72b-v1-iMat-IQ1_S.gguf
Safe
22.7 GB
LFS
Upload magnum-72b-v1-iMat-IQ1_S.gguf
5 months ago
magnum-72b-v1-iMat-IQ2_S.gguf
Safe
27.9 GB
LFS
Upload magnum-72b-v1-iMat-IQ2_S.gguf
5 months ago
magnum-72b-v1-iMat-IQ2_XS.gguf
Safe
27.1 GB
LFS
Upload magnum-72b-v1-iMat-IQ2_XS.gguf
5 months ago
magnum-72b-v1-iMat-IQ2_XXS.gguf
Safe
25.5 GB
LFS
Upload magnum-72b-v1-iMat-IQ2_XXS.gguf
5 months ago
magnum-72b-v1-iMat-IQ3_M.gguf
Safe
35.5 GB
LFS
Upload magnum-72b-v1-iMat-IQ3_M.gguf
5 months ago
magnum-72b-v1-iMat-IQ3_S.gguf
Safe
34.5 GB
LFS
Upload magnum-72b-v1-iMat-IQ3_S.gguf
5 months ago
magnum-72b-v1-iMat-IQ3_XS.gguf
Safe
32.8 GB
LFS
Upload magnum-72b-v1-iMat-IQ3_XS.gguf
5 months ago
magnum-72b-v1-iMat-IQ3_XXS.gguf
Safe
31.8 GB
LFS
Upload magnum-72b-v1-iMat-IQ3_XXS.gguf
5 months ago
magnum-72b-v1-iMat-IQ4_XS.gguf
Safe
39.7 GB
LFS
Upload magnum-72b-v1-iMat-IQ4_XS.gguf
5 months ago
magnum-72b-v1-iMat-Q2_K.gguf
Safe
29.8 GB
LFS
Upload magnum-72b-v1-iMat-Q2_K.gguf
5 months ago
magnum-72b-v1-iMat-Q3_K_M.gguf
Safe
37.7 GB
LFS
Upload magnum-72b-v1-iMat-Q3_K_M.gguf
5 months ago
magnum-72b-v1-iMat-Q4_K_M.gguf
Safe
47.4 GB
LFS
Upload magnum-72b-v1-iMat-Q4_K_M.gguf
5 months ago
magnum-72b-v1-iMat-Q4_K_S.gguf
Safe
43.9 GB
LFS
Upload magnum-72b-v1-iMat-Q4_K_S.gguf
5 months ago
magnum-72b-v1-iMat-Q5_K_M-00001-of-00002.gguf
Safe
45 GB
LFS
Upload 2 files
5 months ago
magnum-72b-v1-iMat-Q5_K_M-00002-of-00002.gguf
Safe
9.46 GB
LFS
Upload 2 files
5 months ago
magnum-72b-v1-iMat-Q5_K_S-00001-of-00002.gguf
Safe
45 GB
LFS
Upload 2 files
5 months ago
magnum-72b-v1-iMat-Q5_K_S-00002-of-00002.gguf
Safe
6.41 GB
LFS
Upload 2 files
5 months ago
magnum-72b-v1-iMat-Q6_K-00001-of-00002.gguf
Safe
44.8 GB
LFS
Upload 2 files
5 months ago
magnum-72b-v1-iMat-Q6_K-00002-of-00002.gguf
Safe
19.6 GB
LFS
Upload 2 files
5 months ago
magnum-72b-v1-iMat-Q8_0-00001-of-00002.gguf
Safe
45 GB
LFS
Upload 2 files
5 months ago
magnum-72b-v1-iMat-Q8_0-00002-of-00002.gguf
Safe
32.3 GB
LFS
Upload 2 files
5 months ago
