Update README.md
Browse files
README.md
CHANGED
|
@@ -13,6 +13,7 @@ Hparams:
|
|
| 13 |
- LR: 1e-5
|
| 14 |
- Weight Decay: 0.02
|
| 15 |
- grad-clip: 0.2
|
|
|
|
| 16 |
|
| 17 |
pretrained on a buncha LNs, books, etc.
|
| 18 |
Used for a base for Pascal.
|
|
|
|
| 13 |
- LR: 1e-5
|
| 14 |
- Weight Decay: 0.02
|
| 15 |
- grad-clip: 0.2
|
| 16 |
+
- R64, A32, Rslora.
|
| 17 |
|
| 18 |
pretrained on a buncha LNs, books, etc.
|
| 19 |
Used for a base for Pascal.
|