Spaces:

lucalp
/

blt-entropy-patcher

Running on Zero

App Files Files Community

blt-entropy-patcher / bytelatent /data /iterators

Ctrl+K

Ctrl+K

12 contributors

History: 5 commits

par-meta's picture

This includes fixes that make checkpointing and reloading work correctly. (#35)

7044771 unverified 4 months ago

__init__.py

53 Bytes

Initial commit 5 months ago
abstract_iterator.py
480 Bytes

Initial commit 5 months ago
arrow_iterator.py
10.5 kB

Replace regular filesystem calls with fsspec + add s3 support (#18) 4 months ago
looping_iterator.py
1.08 kB

Initial commit 5 months ago
multiprocess_iterator.py
10.5 kB

This includes fixes that make checkpointing and reloading work correctly. (#35) 4 months ago
packing_iterator.py
10.7 kB

Initial codes and scripts for training entropy model (#34) 4 months ago
preprocess_iterator.py
4.07 kB

Initial commit 5 months ago
sampling_iterator.py
2.3 kB

Initial commit 5 months ago
sequence_iterator.py
5.46 kB

Initial codes and scripts for training entropy model (#34) 4 months ago
test_arrow_iterator.py
2.92 kB

Changes for training entropy model and correcting attention in local models (#25) 4 months ago
test_iters.py
5.1 kB

Initial commit 5 months ago