Muon Optimizer Test
This directory contains a test script for the Muon optimizer.
To execute the test, simply run:
# By default, the test will use 8 GPUs.
./run_test.sh
The number of GPUs can be controlled with the NGPU environment variable. For example, to run with 4 GPUs:
NGPU=4 ./run_test.sh
Limitations:
- Multi-node execution is not supported yet.
- Ensure that the specified number of GPUs is available on your machine before running.