SamTheDev
/

Qwen3-0.6B-oga

Text Generation

onnxruntime-genai

Model card Files Files and versions Community

My Tests (Tesla P4)

CUDA int4: 1153 MiB, 12 TPS
CUDA fp16: 2179 MiB, 29 TPS
CUDA fp32: dnf

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for SamTheDev/Qwen3-0.6B-oga

Base model

Qwen/Qwen3-0.6B-Base

Finetuned

Qwen/Qwen3-0.6B

Quantized

(130)

this model

Collection including SamTheDev/Qwen3-0.6B-oga

Onnxruntime-Genai Models

onnxruntime-genai models that i've tested on the nvidia tesla p4 • 2 items • Updated 20 days ago