Commit
·
4898144
1
Parent(s):
f606969
Update README.md
Browse files
README.md
CHANGED
|
@@ -75,7 +75,7 @@ image.save("fantasy_forest_illustration.png")
|
|
| 75 |
|
| 76 |
## Training
|
| 77 |
|
| 78 |
-
**Training Data
|
| 79 |
The model was trained on the following dataset:
|
| 80 |
- [Imaginary Network Expanded Dataset](https://github.com/Sygil-Dev/INE-dataset) dataset.
|
| 81 |
|
|
@@ -83,12 +83,20 @@ The model was trained on the following dataset:
|
|
| 83 |
- **Hardware:** 1 x Nvidia RTX 3050 8GB GPU
|
| 84 |
- **Hours Trained:** 520 hours approximately.
|
| 85 |
- **Optimizer:** AdamW
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 86 |
- **Gradient Accumulations**: 4
|
| 87 |
- **Batch:** 1
|
| 88 |
- **Learning rate:** warmup to 1e-7 for 10,000 steps and then kept constant
|
|
|
|
|
|
|
|
|
|
| 89 |
- **Total Training Steps:** 1,489,983
|
| 90 |
|
| 91 |
-
Developed by: [ZeroCool94](https://
|
| 92 |
|
| 93 |
## Community Contributions:
|
| 94 |
- [Kevin Turner (keturn)](https://huggingface.co/keturn): created the [INE-dataset-explorer](https://huggingface.co/spaces/Sygil/INE-dataset-explorer) space for better browsing of the INE dataset.
|
|
|
|
| 75 |
|
| 76 |
## Training
|
| 77 |
|
| 78 |
+
**Training Data**:
|
| 79 |
The model was trained on the following dataset:
|
| 80 |
- [Imaginary Network Expanded Dataset](https://github.com/Sygil-Dev/INE-dataset) dataset.
|
| 81 |
|
|
|
|
| 83 |
- **Hardware:** 1 x Nvidia RTX 3050 8GB GPU
|
| 84 |
- **Hours Trained:** 520 hours approximately.
|
| 85 |
- **Optimizer:** AdamW
|
| 86 |
+
- **Adam Beta 1**: 0.9
|
| 87 |
+
- **Adam Beta 2**: 0.999
|
| 88 |
+
- **Adam Weight Decay**: 0.01
|
| 89 |
+
- **Adam Epsilon**: 1e-8
|
| 90 |
+
- **Gradient Checkpointing**: True
|
| 91 |
- **Gradient Accumulations**: 4
|
| 92 |
- **Batch:** 1
|
| 93 |
- **Learning rate:** warmup to 1e-7 for 10,000 steps and then kept constant
|
| 94 |
+
- **Lora unet Learning Rate**: 1e-7
|
| 95 |
+
- **Lora Text Encoder Learning Rate**: 1e-7
|
| 96 |
+
- **Resolution**: 512 pixels
|
| 97 |
- **Total Training Steps:** 1,489,983
|
| 98 |
|
| 99 |
+
Developed by: [ZeroCool94](https://github.com/ZeroCool940711) at [Sygil-Dev](https://github.com/Sygil-Dev/)
|
| 100 |
|
| 101 |
## Community Contributions:
|
| 102 |
- [Kevin Turner (keturn)](https://huggingface.co/keturn): created the [INE-dataset-explorer](https://huggingface.co/spaces/Sygil/INE-dataset-explorer) space for better browsing of the INE dataset.
|