Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

Vinitha2004
/
qwen2.5-coder-3b-instruct-awq-gguf

PEFT
GGUF
knowledge-distillation
code-generation
qwen
lora
distilled
Model card Files Files and versions Community
qwen2.5-coder-3b-instruct-awq-gguf
Ctrl+K
Ctrl+K
  • 1 contributor
History: 2 commits
Vinitha2004's picture
Vinitha2004
Upload distilled Qwen2.5-Coder-3B model with knowledge distillation
88eee7d verified 21 days ago
  • .gitattributes
    1.73 kB
    Upload distilled Qwen2.5-Coder-3B model with knowledge distillation 21 days ago
  • README.md
    2.22 kB
    Upload distilled Qwen2.5-Coder-3B model with knowledge distillation 21 days ago
  • fast_inference.py
    6.51 kB
    Upload distilled Qwen2.5-Coder-3B model with knowledge distillation 21 days ago
  • model_f16.gguf
    6.18 GB
    LFS
    Upload distilled Qwen2.5-Coder-3B model with knowledge distillation 21 days ago
  • model_q4_0.gguf
    1.82 GB
    LFS
    Upload distilled Qwen2.5-Coder-3B model with knowledge distillation 21 days ago
  • model_q5_0.gguf
    2.17 GB
    LFS
    Upload distilled Qwen2.5-Coder-3B model with knowledge distillation 21 days ago
  • model_q8_0.gguf
    3.29 GB
    LFS
    Upload distilled Qwen2.5-Coder-3B model with knowledge distillation 21 days ago
  • training_metadata.json
    364 Bytes
    Upload distilled Qwen2.5-Coder-3B model with knowledge distillation 21 days ago