Post
1907
I gave rectified flow a try, so here is nanoRF - a lightweight implementation of a Rectified Flow Transformer model, ~ 618k parameters, 6 layers deep, dim 64, patch size 4, learning rate 5e-4 trained on my 8bg ram m2 macbookair for 2k epochs.
Code: https://github.com/Jaykef/ai-algorithms/blob/main/nanoRF.ipynb
See demo: https://x.com/Jaykef_/status/1923718725578129838
Reference Paper: https://arxiv.org/abs/2403.03206.
Code: https://github.com/Jaykef/ai-algorithms/blob/main/nanoRF.ipynb
See demo: https://x.com/Jaykef_/status/1923718725578129838
Reference Paper: https://arxiv.org/abs/2403.03206.