Edit model card

YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

The vanilla model used in our Expert-Specialized Fine-Tuning (ESFT) research paper: https://arxiv.org/abs/2407.01906.

To use this model and specialized expert sets, please refer to the scripts at https://github.com/deepseek-ai/ESFT.

For the customized models used in this paper, please refer to https://huggingface.co/deepseek-ai/ESFT-{gate, token}-{task_name}-lite.

Safetensors

Model size

15.7B params

Tensor type

BF16

Inference Examples

Inference API (serverless) does not yet support model repos that contain custom code.

Collection including deepseek-ai/ESFT-vanilla-lite