shuttleai
/

shuttle-3.5-moe-ckpts

Generated from Trainer

4-bit precision

Model card Files Files and versions Community

shuttle-3.5-moe-ckpts / checkpoint-1044 /global_step1044

Ctrl+K

Ctrl+K

1 contributor

History: 1 commit

xtristan's picture

Training in progress, step 1044, checkpoint

58ff768 verified 12 days ago

bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt
Detected Pickle imports (9)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.FloatStorage",
- "torch._tensor._rebuild_from_type_v2",
- "torch.Tensor",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "collections.OrderedDict"
How to fix it?
20.4 GB
LFS

Training in progress, step 1044, checkpoint 12 days ago
mp_rank_00_model_states.pt
Detected Pickle imports (7)
- "torch.Size",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "__builtin__.set",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "torch.ByteStorage"
How to fix it?
7.32 GB
LFS

Training in progress, step 1044, checkpoint 12 days ago