PowerInfer
/

SmallThinker-4BA0.6B-Instruct-INT4-QAT

Model card Files Files and versions

README.md exists but content is empty.

Downloads last month: 116

GGUF

Model size

4B params

Architecture

smallthinker

Hardware compatibility

Log In to view the estimation

3-bit

4-bit

8-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for PowerInfer/SmallThinker-4BA0.6B-Instruct-INT4-QAT

Base model

PowerInfer/SmallThinker-4BA0.6B-Instruct

Quantized

(8)

this model