BabyLM Sequence Length

community

AI & ML interests

BabyLM 2025 paper submission

Recent Activity

rdiehlmartinez updated a model about 1 month ago

babylm-seqlen/mamba-2048-warmup-v2

rdiehlmartinez updated a model about 1 month ago

babylm-seqlen/opt-2048-warmup-v2

codebyzeb updated a model about 2 months ago

babylm-seqlen/mamba-2048-warmup-v2

View all activity

babylm-seqlen 's datasets 18

babylm-seqlen/train_100M_64

Viewer • Updated Apr 8 • 2.56M • 6

babylm-seqlen/train_100M_512_single_shuffle

Viewer • Updated Apr 8 • 319k • 3

babylm-seqlen/train_100M_8192_single_shuffle

Viewer • Updated Apr 8 • 19.8k • 5

babylm-seqlen/train_100M_2048_single_shuffle

Viewer • Updated Apr 8 • 79.8k • 5

babylm-seqlen/train_100M_16384_single_shuffle

Viewer • Updated Apr 8 • 9.86k • 6

babylm-seqlen/train_100M_4096_single_shuffle

Viewer • Updated Apr 8 • 39.8k • 3

babylm-seqlen/train_100M_256_single_shuffle

Viewer • Updated Apr 8 • 639k • 4

babylm-seqlen/train_100M_1024_single_shuffle

Viewer • Updated Apr 8 • 160k • 4

babylm-seqlen/train_100M_128_single_shuffle

Viewer • Updated Apr 8 • 1.28M • 5

babylm-seqlen/train_100M_64_single_shuffle

Viewer • Updated Apr 8 • 2.56M • 6

babylm-seqlen/train_100M_128

Viewer • Updated Apr 8 • 1.28M • 4

babylm-seqlen/train_100M_256

Viewer • Updated Apr 7 • 639k • 2

babylm-seqlen/train_100M_1024

Viewer • Updated Apr 7 • 160k • 4

babylm-seqlen/train_100M_4096

Viewer • Updated Apr 7 • 39.8k • 8

babylm-seqlen/train_100M_16384

Viewer • Updated Apr 7 • 9.86k • 5

babylm-seqlen/train_100M_8192

Viewer • Updated Apr 7 • 19.8k • 4

babylm-seqlen/train_100M_2048

Viewer • Updated Apr 7 • 79.8k • 4

babylm-seqlen/train_100M_512

Viewer • Updated Apr 7 • 319k • 3