Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

matrixportal
/
Qwen2.5-3B-Instruct-GGUF

Text Generation
Transformers
GGUF
English
chat
llama-cpp
gguf-my-repo
conversational
Model card Files Files and versions
xet
Community
1
Qwen2.5-3B-Instruct-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 10 commits
matrixportal's picture
matrixportal
Upload README.md with huggingface_hub
17ca3e2 verified 5 months ago
  • .gitattributes
    1.79 kB
    Upload qwen2.5-3b-instruct-q4_k_m.gguf with huggingface_hub 6 months ago
  • README.md
    1.93 kB
    Upload README.md with huggingface_hub 5 months ago
  • qwen2.5-3b-instruct-q4_k_m.gguf
    1.93 GB
    xet
    Upload qwen2.5-3b-instruct-q4_k_m.gguf with huggingface_hub 6 months ago
  • qwen2.5-3b-instruct-q5_k_m.gguf
    2.22 GB
    xet
    Upload qwen2.5-3b-instruct-q5_k_m.gguf with huggingface_hub 6 months ago
  • qwen2.5-3b-instruct-q6_k.gguf
    2.54 GB
    xet
    Upload qwen2.5-3b-instruct-q6_k.gguf with huggingface_hub 6 months ago
  • qwen2.5-3b-instruct-q8_0.gguf
    3.29 GB
    xet
    Upload qwen2.5-3b-instruct-q8_0.gguf with huggingface_hub 6 months ago