pretrain core 3
Browse files
README.md
CHANGED
|
@@ -334,3 +334,10 @@ CUDA_VISIBLE_DEVICES=0 CUDA_LAUNCH_BLOCKING=0 PYTORCH_CUDA_ALLOC_CONF=expandable
|
|
| 334 |
```bash
|
| 335 |
litgpt convert_pretrained_checkpoint ../out/pretrain-core-2/final ../out/pretrain-core-2/checkpoint
|
| 336 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 334 |
```bash
|
| 335 |
litgpt convert_pretrained_checkpoint ../out/pretrain-core-2/final ../out/pretrain-core-2/checkpoint
|
| 336 |
```
|
| 337 |
+
|
| 338 |
+
```bash
|
| 339 |
+
CUDA_VISIBLE_DEVICES=0 CUDA_LAUNCH_BLOCKING=0 PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True litgpt pretrain --config pretrain_core_model_3.yaml
|
| 340 |
+
```
|
| 341 |
+
|
| 342 |
+
```
|
| 343 |
+
```
|