yuzhaouoe/BM25Chunk
Text Generation
•
Updated
•
9
Pre-Trianing Data Packing
[ACL'24] Analysing the Impact of Sequence Composition on Language Model Pre-Training. https://github.com/yuzhaouoe/pretraining-data-packing
-
-
yuzhaouoe/UniChunk
Text Generation • Updated • 6 -
yuzhaouoe/BM25Chunk-2048
Text Generation • Updated • 4 -
yuzhaouoe/MixChunk
Text Generation • Updated • 5 -
yuzhaouoe/IntraDoc
Text Generation • Updated • 6 -
yuzhaouoe/UniChunk-2048
Text Generation • Updated • 4 -
yuzhaouoe/MixChunk-2048
Text Generation • Updated • 3 -
yuzhaouoe/IntraDoc-2048
Text Generation • Updated • 4 -
yuzhaouoe/eval_data
Updated -
Analysing The Impact of Sequence Composition on Language Model Pre-Training
Paper • 2402.13991 • Published • 1