xrsrke commited on
Commit
5cc7587
·
1 Parent(s): 2ee660e

add torchgpipe to appendex

Browse files
Files changed (2) hide show
  1. dist/index.html +5 -0
  2. src/index.html +5 -0
dist/index.html CHANGED
@@ -2382,6 +2382,11 @@
2382
  <p>Training language models across compute clusters with DiLoCo.</p>
2383
  </div>
2384
 
 
 
 
 
 
2385
  <h3>Debugging</h3>
2386
 
2387
  <div>
 
2382
  <p>Training language models across compute clusters with DiLoCo.</p>
2383
  </div>
2384
 
2385
+ <div>
2386
+ <a href="https://github.com/kakaobrain/torchgpipe"><strong>torchgpipe</strong></a>
2387
+ <p>A GPipe implementation in PyTorch.</p>
2388
+ </div>
2389
+
2390
  <h3>Debugging</h3>
2391
 
2392
  <div>
src/index.html CHANGED
@@ -2381,6 +2381,11 @@
2381
  <a href="https://github.com/PrimeIntellect-ai/OpenDiLoCo"><strong>DiLoco</strong></a>
2382
  <p>Training language models across compute clusters with DiLoCo.</p>
2383
  </div>
 
 
 
 
 
2384
 
2385
  <h3>Debugging</h3>
2386
 
 
2381
  <a href="https://github.com/PrimeIntellect-ai/OpenDiLoCo"><strong>DiLoco</strong></a>
2382
  <p>Training language models across compute clusters with DiLoCo.</p>
2383
  </div>
2384
+
2385
+ <div>
2386
+ <a href="https://github.com/kakaobrain/torchgpipe"><strong>torchgpipe</strong></a>
2387
+ <p>torchgpipe: On-the-fly Pipeline Parallelism for Training Giant Models.</p>
2388
+ </div>
2389
 
2390
  <h3>Debugging</h3>
2391