blt-entropy-patcher / requirements.txt
par-meta's picture
Update preprocess_entropies script to blt inference + add fsspec support (#23)
1da3dd9 unverified
raw
history blame
201 Bytes
numpy
omegaconf
msgspec
rouge-score
sacrebleu
sentencepiece
tiktoken
fsspec
blobfile
wandb
viztracer
lm-eval
scipy
pynvml
datatrove
orjson
luigi
pydantic
altair
submitit
typer
rich
fsspec[full]
orjson