ngxson
/

DeepSeek-R1-Distill-Qwen-7B-abliterated-GGUF

Text Generation

Model card Files Files and versions Community

DeepSeek-R1-Distill-Qwen-7B-abliterated-GGUF

This is made by using llama-export-lora

Base model: https://huggingface.co/bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF
LoRA adapter: https://huggingface.co/ggml-org/LoRA-Qwen2.5-7B-Instruct-abliterated-v3-F16-GGUF

Downloads last month: 2,360

GGUF

Model size

7.62B params

Architecture

qwen2

4-bit

16-bit

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ngxson/DeepSeek-R1-Distill-Qwen-7B-abliterated-GGUF

Base model

deepseek-ai/DeepSeek-R1-Distill-Qwen-7B

Quantized

(128)

this model

Space using ngxson/DeepSeek-R1-Distill-Qwen-7B-abliterated-GGUF 1