unidisc / docs /EVAL.md
aswerdlow's picture
Initial commit
131da64

Eval

To run evaluation, run the following command:

RUN_CC=1 RUN_DB=1 RUN_FLICKR=1 RUN_COCO=1 RUN_MEDIUM=1 RUN_AR=1 RUN_NAR=1 NUM_GPUS=1 bash scripts/small_scale_eval.sh

RUN_CC, RUN_DB, RUN_FLICKR, RUN_COCO all control which datasets to evaluate on.

RUN_MEDIUM controls whether to run experiments on the 100M or 300M ckpts.

RUN_AR and RUN_NAR control whether to run the AR and NAR ckpts.