DeepSeek-V3 Pruning and Quantization
Collection
11 items
•
Updated
Llamacpp Quantizations of DeepSeek-V3-0324-MoE-Pruner-E192 by tflsxyy
Original model: tflsxyy/DeepSeek-V3-0324-MoE-Pruner-E192-bf16.
All quants made based on bartowski1182-llama.cpp.
All quants made using imatrix option based on tflsxyy/DeepSeek-V3-0324-MoE-Pruner-imatrix.
- IQ1_S (104G) (1.75 BPW)
- IQ1_M_S (106G) (1.78 BPW)
- IQ1_M (114G) (1.92 BPW)
- Downloads last month
- 101
Hardware compatibility
Log In
to view the estimation
1-bit
2-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support