nvidia
/

DeepSeek-V3-0324-FP4

Text Generation

Model Optimizer

Model card Files Files and versions

Resources

View closed (1)

Fix model config

#4 opened 3 months ago by

The given huggingface model architecture DeepseekV3ForCausalLM is not supported in TRT-LLM yet

#3 opened 3 months ago by

How to run model on 8xH200

#2 opened 4 months ago by

Remove quantization_config from config.json

#1 opened 4 months ago by