Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

legraphista
/
Qwen2.5-72B-Instruct-IMat-GGUF

Text Generation
GGUF
English
chat
quantized
GGUF
quantization
imat
imatrix
static
16bit
8bit
6bit
5bit
4bit
3bit
2bit
1bit
conversational
Model card Files Files and versions Community
1
Qwen2.5-72B-Instruct-IMat-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 18 commits
legraphista's picture
legraphista
Upload Qwen2.5-72B-Instruct.Q5_K_S/Qwen2.5-72B-Instruct.Q5_K_S-00001-of-00003.gguf with huggingface_hub
0d71190 verified 8 months ago
  • Qwen2.5-72B-Instruct.Q5_K
    Upload Qwen2.5-72B-Instruct.Q5_K/Qwen2.5-72B-Instruct.Q5_K-00001-of-00003.gguf with huggingface_hub 8 months ago
  • Qwen2.5-72B-Instruct.Q5_K_S
    Upload Qwen2.5-72B-Instruct.Q5_K_S/Qwen2.5-72B-Instruct.Q5_K_S-00001-of-00003.gguf with huggingface_hub 8 months ago
  • Qwen2.5-72B-Instruct.Q6_K
    Upload Qwen2.5-72B-Instruct.Q6_K/Qwen2.5-72B-Instruct.Q6_K-00001-of-00003.gguf with huggingface_hub 8 months ago
  • Qwen2.5-72B-Instruct.Q8_0
    Upload Qwen2.5-72B-Instruct.Q8_0/Qwen2.5-72B-Instruct.Q8_0-00004-of-00004.gguf with huggingface_hub 8 months ago
  • .gitattributes
    2.94 kB
    Upload Qwen2.5-72B-Instruct.Q5_K_S/Qwen2.5-72B-Instruct.Q5_K_S-00001-of-00003.gguf with huggingface_hub 8 months ago
  • README.md
    7.03 kB
    Upload README.md with huggingface_hub 8 months ago