qwen3-1.7b-instruct-gguf

qwen3-1.7b-instruct-gguf is a GGUF Q4_K_M int4 quantized version of Qwen3-1.7B, providing a very fast inference implementation, optimized for AI PCs.

Model Description

  • Developed by: Qwen
  • Model type: qwen3
  • Parameters: 1.7 billion
  • Model Parent: Qwen/Qwen3-1.7B-Instruct
  • Language(s) (NLP): English
  • License: Apache 2.0
  • Uses: Chat, general-purpose LLM
  • Quantization: int4

Model Card Contact

llmware on github

llmware on hf

llmware website

Downloads last month
10
GGUF
Model size
1.72B params
Architecture
qwen3
Hardware compatibility
Log In to view the estimation

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support