nev's picture
Add files using upload-large-folder tool
6f58daf verified
raw
history blame contribute delete
280 Bytes
{
"dataset_repo": "EleutherAI/fineweb-edu-dedup-10b",
"dataset_split": "train",
"dataset_name": "",
"dataset_column": "text",
"batch_size": 16,
"cache_ctx_len": 256,
"n_tokens": 10000000,
"n_splits": 5,
"model_name": "meta-llama/Llama-3.2-1B"
}