aws-neuron

/

Mistral-7B-Instruct-v0.3-seqlen-2048-bs-1-cores-2

like 0

Follow

AWS Inferentia and Trainium 134

• "__torch__.neuronx_distributed.trace.spmd.NxDModelExecutor",
• "__torch__.torch.classes.neuron.LayoutTransformation",
• "__torch__.neuronx_distributed.trace.spmd.NxDModel",
• "torch.jit._pickle.restore_type_tag",
• "torch.jit._pickle.build_intlist",
• "torch.jit._pickle.build_intlist",
• "torch.jit._pickle.build_intlist",
• "torch.jit._pickle.build_intlist",
• "torch.jit._pickle.build_intlist",
• "torch.jit._pickle.build_intlist",
• "torch.jit._pickle.build_intlist",
• "collections.OrderedDict",
• "torch.jit._pickle.restore_type_tag",
• "torch._utils._rebuild_tensor_v2",
• "torch.FloatStorage",
• "torch.IntStorage"

How to fix it?