Update README.md
Browse filesAdd link to Colab to run the models
README.md
CHANGED
@@ -6,18 +6,21 @@ Checkpoint 278k-full_state_dict.pth has been trained on about 500 epochs and is
|
|
6 |
The two checkpoints for 300k and 395k steps were further trained on a Midjourney dataset of 600k images for 9.4 epochs (300k steps) and 50 epochs (395k steps) at a constant LR of 5e-5.
|
7 |
The additional training on the MJ dataset took ~8 hours on a 4090 with batch size 256.
|
8 |
|
9 |
-
The models are the same as in the Google
|
|
|
|
|
|
|
10 |
|
11 |
# Colab Training Notebook
|
12 |
https://colab.research.google.com/drive/1sKk0usxEF4bmdCDcNQJQNMt4l9qBOeAM?usp=sharing
|
13 |
|
14 |
-
# Github Repo
|
15 |
This repo contains the original training code:
|
16 |
https://github.com/apapiu/transformer_latent_diffusion
|
17 |
|
18 |
-
# Datasets
|
19 |
https://huggingface.co/apapiu/small_ldt/tree/main
|
20 |
|
21 |
# Other
|
22 |
-
See this Reddit post by u/spring_m for some more information:
|
23 |
https://www.reddit.com/r/MachineLearning/comments/198eiv1/p_small_latent_diffusion_transformer_from_scratch/
|
|
|
6 |
The two checkpoints for 300k and 395k steps were further trained on a Midjourney dataset of 600k images for 9.4 epochs (300k steps) and 50 epochs (395k steps) at a constant LR of 5e-5.
|
7 |
The additional training on the MJ dataset took ~8 hours on a 4090 with batch size 256.
|
8 |
|
9 |
+
The models are the same as in the Google Colabs below: embed_dim=512, n_layers=8, total parameters=30507328 (30M)
|
10 |
+
|
11 |
+
# Run the Models in Colab
|
12 |
+
https://colab.research.google.com/drive/10yORcKXT40DLvZSceOJ1Hi5z_p5r-bOs?usp=sharing
|
13 |
|
14 |
# Colab Training Notebook
|
15 |
https://colab.research.google.com/drive/1sKk0usxEF4bmdCDcNQJQNMt4l9qBOeAM?usp=sharing
|
16 |
|
17 |
+
# Github Repo
|
18 |
This repo contains the original training code:
|
19 |
https://github.com/apapiu/transformer_latent_diffusion
|
20 |
|
21 |
+
# Datasets used
|
22 |
https://huggingface.co/apapiu/small_ldt/tree/main
|
23 |
|
24 |
# Other
|
25 |
+
See this Reddit post by u/spring_m (huggingface.co/apapiu) for some more information:
|
26 |
https://www.reddit.com/r/MachineLearning/comments/198eiv1/p_small_latent_diffusion_transformer_from_scratch/
|