Hugging Face's logo

bobchenyx
/
DeepSeek-V3-0324-MoE-Pruner-E192-GGUF

Text Generation
Transformers
GGUF
deepseek_v3
deepseek
GGUF
imatrix
conversational
Model card Files
xet
Community

Llamacpp Quantizations of DeepSeek-V3-0324-MoE-Pruner-E192 by tflsxyy

Original model: tflsxyy/DeepSeek-V3-0324-MoE-Pruner-E192-bf16.

All quants made based on bartowski1182-llama.cpp.

All quants made using imatrix option based on tflsxyy/DeepSeek-V3-0324-MoE-Pruner-imatrix.

  • IQ1_S (104G) (1.75 BPW)
  • IQ1_M_S (106G) (1.78 BPW)
  • IQ1_M (114G) (1.92 BPW)
Downloads last month
96
GGUF
Model size
508B params
Architecture
deepseek2
Hardware compatibility
Log In to view the estimation

1-bit

2-bit

Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for bobchenyx/DeepSeek-V3-0324-MoE-Pruner-E192-GGUF

Base model

tflsxyy/DeepSeek-V3-0324-MoE-Pruner-E192-bf16
Quantized
(1)
this model

Collection including bobchenyx/DeepSeek-V3-0324-MoE-Pruner-E192-GGUF