qwen-2-1.5b-instruct-gguf

qwen-2-1.5b-instruct-gguf is Q4_K_M (int 4) quantized version of Qwen2 1.5b Instruct, providing a very fast, very small inference implementation, optimized for AI PCs.

qwen-2-1.5b-instruct-gguf is a leading chat model known for its high accuracy and strong math and logical capabilities.

Model Description

  • Developed by: Qwen
  • Quantized by: llmware
  • Model type: qwen2-1.5b-instruct
  • Parameters: 1.5 billion
  • Model Parent: Qwen/Qwen2 1.5B-Instruct
  • Language(s) (NLP): English
  • License: Apache 2.0
  • Uses: General purpose chat
  • RAG Benchmark Accuracy Score: NA
  • Quantization: Q4_K_M

Model Card Contact

llmware on github

llmware on hf

llmware website

Downloads last month
8
GGUF
Model size
1.54B params
Architecture
qwen2
Hardware compatibility
Log In to view the estimation
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for llmware/qwen2-1.5b-instruct-gguf

Quantized
(61)
this model