qwen-2-0.5b-instruct-gguf

qwen-2-0.5b-instruct-gguf is Q4_K_M (int 4) quantized version of Qwen2 0.5b Instruct, providing a very fast, very small inference implementation, optimized for AI PCs.

qwen-2-0.5b-instruct-gguf is a leading chat model known for its high accuracy and strong math and logical capabilities.

Model Description

  • Developed by: Qwen
  • Quantized by: llmware
  • Model type: qwen2-0.5b-instruct
  • Parameters: 0.5 billion
  • Model Parent: Qwen/Qwen2 0.5B-Instruct
  • Language(s) (NLP): English
  • License: Apache 2.0
  • Uses: General purpose chat
  • RAG Benchmark Accuracy Score: NA
  • Quantization: Q4_K_M

Model Card Contact

llmware on github

llmware on hf

llmware website

Downloads last month
11
GGUF
Model size
494M params
Architecture
qwen2
Hardware compatibility
Log In to view the estimation

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for llmware/qwen-2-0.5b-gguf

Base model

Qwen/Qwen2-0.5B
Quantized
(79)
this model