Qwen
/

Qwen2.5-Coder-32B-Instruct-GPTQ-Int4

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

it run locally 16gb vram

#1

by sdyy - opened 2 days ago

sdyy

2 days ago

https://github.com/werruww/Qwen2.5-Coder-32B-4bit-locally/tree/main

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment