Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
formll
/
resolving-scaling-law-discrepancies
like
5
Follow
Foundations of Robust Machine Learning Lab
3
RefinedWeb
EleutherAI/OpenWebText2
open_lm
arxiv:
2406.19146
License:
mit
Model card
Files
Files and versions
Community
e08f01f
resolving-scaling-law-discrepancies
/
dataset=rw
Ctrl+K
Ctrl+K
1 contributor
History:
120 commits
TomerPorian
Add files using large-upload tool
ba6ffae
verified
12 months ago
hparams=base_warmup=long_decay=kaplan
Add files using large-upload tool
12 months ago
hparams=base_warmup=short_decay=chinchilla
Add files using large-upload tool
12 months ago
hparams=base_warmup=short_decay=kaplan
Add files using large-upload tool
12 months ago
hparams=tuned_warmup=long_decay=const
Add files using large-upload tool
12 months ago
hparams=tuned_warmup=short_decay=const
Add files using large-upload tool
12 months ago