unsloth
/

DeepSeek-R1-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Resources

View closed (3)

No think tokens visible

#15 opened about 7 hours ago by

Over 2 tok/sec agg backed by NVMe SSD on 96GB RAM + 24GB VRAM AM5 rig with llama.cpp

#13 opened about 24 hours ago by

Running the model with vLLM does not actually work

#12 opened 1 day ago by

DeepSeek-R1-GGUF on LMStudio not available

#11 opened 1 day ago by

Where did the BF16 come from?

#10 opened 1 day ago by

Inference speed

#9 opened 2 days ago by

Running this model using vLLM Docker

#8 opened 2 days ago by

UD-IQ1_M models for distilled R1 versions?

#6 opened 3 days ago by

Llama.cpp server chat template

#4 opened 5 days ago by

Are the Q4 and Q5 models R1 or R1-Zero

#2 opened 10 days ago by

What is the VRAM requirement to run this ?

#1 opened 10 days ago by