babylm-seqlen
/

mamba-64-warmup-v2

Model card Files Files and versions Community

mamba-64-warmup-v2

Ctrl+K

Ctrl+K

1 contributor

History: 29 commits

rdiehlmartinez's picture

Checkpoint step: 399,438 | Target words: 1,000,000,000 | Actual tokens: 1,636,098,048 | Actual words: 1,000,000,000.0 | Progress: 28/28

25bfb08 verified about 2 months ago

.gitattributes

1.52 kB

initial commit about 2 months ago
config.json

765 Bytes

Checkpoint step: 400 | Target words: 1,000,000 | Actual tokens: 1,638,400 | Actual words: 1,001,406.9768024074 | Progress: 1/28 about 2 months ago
model.safetensors

637 MB
LFS

Checkpoint step: 399,438 | Target words: 1,000,000,000 | Actual tokens: 1,636,098,048 | Actual words: 1,000,000,000.0 | Progress: 28/28 about 2 months ago
training_args.bin
Detected Pickle imports (10)
- "transformers.training_args.TrainingArguments",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.trainer_utils.HubStrategy",
- "accelerate.state.PartialState",
- "torch.device",
- "transformers.trainer_utils.SaveStrategy",
- "transformers.trainer_utils.SchedulerType",
- "transformers.training_args.OptimizerNames",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "transformers.trainer_utils.IntervalStrategy"
How to fix it?
5.84 kB
LFS

Checkpoint step: 400 | Target words: 1,000,000 | Actual tokens: 1,638,400 | Actual words: 1,001,406.9768024074 | Progress: 1/28 about 2 months ago