wyldecat's picture
feat(muon): add test for muon
3261444

Muon Optimizer Test

This directory contains a test script for the Muon optimizer.

To execute the test, simply run:

# By default, the test will use 8 GPUs.
./run_test.sh

The number of GPUs can be controlled with the NGPU environment variable. For example, to run with 4 GPUs:

NGPU=4 ./run_test.sh

Limitations:

  • Multi-node execution is not supported yet.
  • Ensure that the specified number of GPUs is available on your machine before running.