Spaces:

nanotron
/

ultrascale-playbook

Running

App Files Files Community

Resources

View closed (91)

Questions?

#84 opened 2 months ago by

More ressources

#73 opened 2 months ago by

How to understand the graph "Tensor parallelism with column linear + row Linear"

#109 opened about 1 hour ago by

Incorrect link in Data Parallelism?

#108 opened 4 days ago by

Thoughts on adding Hybrid Sharded Data Parallel to the guide

#107 opened 10 days ago by

Typo in Sequence Parallelism TO -> TP

#106 opened 12 days ago by

Wrong section title for FSDP?

#105 opened about 1 month ago by

A mistake ? Weights/grads/optimizer stats memory for mixed precision

#104 opened about 1 month ago by

Questions about pipeline parallelism

#103 opened about 2 months ago by

update

#102 opened about 2 months ago by

Widget does not take TP into account for Parameter / Gradient / Optimizer State Sharding

#98 opened about 2 months ago by

Am I misunderstanding Zero-1 and Zero-2?

#94 opened about 2 months ago by

Fix description of Zero-1

#93 opened about 2 months ago by

Few Errors

#86 opened 2 months ago by

How can the following figure be obtained, and is there a way to tag the name of each tensor during profiling?

#83 opened 2 months ago by

dark-mode

#82 opened 2 months ago by

Thanks for sharing. Was looking for similar research to get to know about compute(AI+GPU)

#79 opened 2 months ago by

Make it easier to import into reader applications

#77 opened 2 months ago by