Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Qwen2.5-7B-Instruct-abliterated-v2-GGUF
like
3
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Use this model
refs/pr/1
Qwen2.5-7B-Instruct-abliterated-v2-GGUF
Ctrl+K
Ctrl+K
1 contributor
History:
7 commits
MaziyarPanahi
f3ca250cacc97e92621d64dfa63a4ec4617993455ac7fc53930d3f7729b89668
eeb48c3
verified
6 months ago
.gitattributes
Safe
2.02 kB
f3ca250cacc97e92621d64dfa63a4ec4617993455ac7fc53930d3f7729b89668
6 months ago
Qwen2.5-7B-Instruct-abliterated-v2-GGUF_imatrix.dat
4.54 MB
LFS
f3ca250cacc97e92621d64dfa63a4ec4617993455ac7fc53930d3f7729b89668
6 months ago
Qwen2.5-7B-Instruct-abliterated-v2.Q5_K_M.gguf
Safe
5.44 GB
LFS
adc4af4b9982992e34e28f39086e44dc04668471c944c711c5589d549beffbe0
6 months ago
Qwen2.5-7B-Instruct-abliterated-v2.Q5_K_S.gguf
Safe
5.32 GB
LFS
9d30d5f2eda9ff333edbe95820a68269d2f37fb0f693fa6ff66dc55268c5c455
6 months ago
Qwen2.5-7B-Instruct-abliterated-v2.Q6_K.gguf
Safe
6.25 GB
LFS
10170aa4cf1944171ce630a6d1133da0821e4947189b0ea8d36405e1b2435733
6 months ago
Qwen2.5-7B-Instruct-abliterated-v2.Q8_0.gguf
Safe
8.1 GB
LFS
312d09f6671dfe0e136d19eaf5f9a64f6b9f1fc71b9cfa6dff31687c511aaf20
6 months ago
Qwen2.5-7B-Instruct-abliterated-v2.fp16.gguf
Safe
15.2 GB
LFS
faedc8d203c9a8e82195b993d1b99422a626aba829aa5d52ba37fe654cac8923
6 months ago
README.md
Safe
3.13 kB
f3ca250cacc97e92621d64dfa63a4ec4617993455ac7fc53930d3f7729b89668
6 months ago
