Kendamarron
/

fineweb-edu-classifier-ja-v2

Text Classification

Model card Files Files and versions

fineweb-edu-classifier-ja-v2

450 MB

1 contributor

History: 2 commits

Kendamarron's picture

Upload folder using huggingface_hub

7c97d05 verified over 1 year ago

.gitattributes

1.52 kB

initial commit over 1 year ago
config.json

974 Bytes

Upload folder using huggingface_hub over 1 year ago
model.safetensors

445 MB
xet

Upload folder using huggingface_hub over 1 year ago
optimizer.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.FloatStorage"
What is a pickle import?
4.77 MB
xet

Upload folder using huggingface_hub over 1 year ago
rng_state.pth
Detected Pickle imports (7)
- "collections.OrderedDict",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "numpy.core.multiarray._reconstruct",
- "_codecs.encode",
- "numpy.ndarray"
How to fix it?
14.2 kB
xet

Upload folder using huggingface_hub over 1 year ago
scheduler.pt
Pickle imports
- No problematic imports detected
What is a pickle import?
1.06 kB
xet

Upload folder using huggingface_hub over 1 year ago
special_tokens_map.json

125 Bytes

Upload folder using huggingface_hub over 1 year ago
tokenizer_config.json

1.4 kB

Upload folder using huggingface_hub over 1 year ago
trainer_state.json

362 kB

Upload folder using huggingface_hub over 1 year ago
training_args.bin
Detected Pickle imports (9)
- "transformers.training_args.OptimizerNames",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.trainer_utils.HubStrategy",
- "torch.device",
- "transformers.training_args.TrainingArguments",
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "accelerate.state.PartialState",
- "transformers.trainer_utils.SchedulerType"
How to fix it?
5.11 kB
xet

Upload folder using huggingface_hub over 1 year ago
vocab.txt

231 kB

Upload folder using huggingface_hub over 1 year ago