RyanYr

/

brm-ace-numina-ace-numina-r1qwen1.5B-base-lr2.5e-6-bfsz1024-mbs2048-beta0.002

like 0

• "torch.distributed.device_mesh.DeviceMesh",
• "torch.distributed.tensor.DTensor",
• "torch.device",
• "collections.OrderedDict",
• "torch.FloatStorage",
• "torch.distributed.tensor._dtensor_spec.DTensorSpec",
• "torch.IntStorage",
• "torch.Size",
• "torch.float32",
• "torch.distributed.tensor.placement_types.Shard",
• "torch.distributed.tensor._dtensor_spec.TensorMeta",
• "torch._utils._rebuild_wrapper_subclass",
• "torch._utils._rebuild_tensor_v2",
• "torch._tensor._rebuild_from_type_v2",
• "torch.serialization._get_layout"

How to fix it?