DeepSeek-V3 Pruning and Quantization
Collection
11 items
•
Updated
Llamacpp Quantizations of DeepSeek-V3-0324-MoE-Pruner-E160 by tflsxyy
Original model: tflsxyy/DeepSeek-V3-0324-MoE-Pruner-E160-bf16
Less activated experts since pruning
"num_experts_per_tok": 6,
"topk_group": 2,
Quants made based on bartowski1182-llama.cpp
- Downloads last month
- 9
Hardware compatibility
Log In
to view the estimation
4-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support