xrsrke
commited on
Commit
·
5cc7587
1
Parent(s):
2ee660e
add torchgpipe to appendex
Browse files- dist/index.html +5 -0
- src/index.html +5 -0
dist/index.html
CHANGED
@@ -2382,6 +2382,11 @@
|
|
2382 |
<p>Training language models across compute clusters with DiLoCo.</p>
|
2383 |
</div>
|
2384 |
|
|
|
|
|
|
|
|
|
|
|
2385 |
<h3>Debugging</h3>
|
2386 |
|
2387 |
<div>
|
|
|
2382 |
<p>Training language models across compute clusters with DiLoCo.</p>
|
2383 |
</div>
|
2384 |
|
2385 |
+
<div>
|
2386 |
+
<a href="https://github.com/kakaobrain/torchgpipe"><strong>torchgpipe</strong></a>
|
2387 |
+
<p>A GPipe implementation in PyTorch.</p>
|
2388 |
+
</div>
|
2389 |
+
|
2390 |
<h3>Debugging</h3>
|
2391 |
|
2392 |
<div>
|
src/index.html
CHANGED
@@ -2381,6 +2381,11 @@
|
|
2381 |
<a href="https://github.com/PrimeIntellect-ai/OpenDiLoCo"><strong>DiLoco</strong></a>
|
2382 |
<p>Training language models across compute clusters with DiLoCo.</p>
|
2383 |
</div>
|
|
|
|
|
|
|
|
|
|
|
2384 |
|
2385 |
<h3>Debugging</h3>
|
2386 |
|
|
|
2381 |
<a href="https://github.com/PrimeIntellect-ai/OpenDiLoCo"><strong>DiLoco</strong></a>
|
2382 |
<p>Training language models across compute clusters with DiLoCo.</p>
|
2383 |
</div>
|
2384 |
+
|
2385 |
+
<div>
|
2386 |
+
<a href="https://github.com/kakaobrain/torchgpipe"><strong>torchgpipe</strong></a>
|
2387 |
+
<p>torchgpipe: On-the-fly Pipeline Parallelism for Training Giant Models.</p>
|
2388 |
+
</div>
|
2389 |
|
2390 |
<h3>Debugging</h3>
|
2391 |
|