Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
bertin-project
/
bertin-roberta-base-spanish
like
38
Follow
BERTIN Project
31
Fill-Mask
Transformers
PyTorch
JAX
TensorBoard
Safetensors
bertin-project/mc4-es-sampled
Spanish
roberta
spanish
arxiv:
2207.06814
arxiv:
2107.07253
arxiv:
1907.11692
License:
cc-by-4.0
Model card
Files
Files and versions
xet
Metrics
Training metrics
Community
1
Deploy
Use this model
36b7dde
bertin-roberta-base-spanish
2.13 GB
8 contributors
History:
21 commits
versae
Merge branch 'main' of https://huggingface.co/flax-community/bertin-roberta-large-spanish into main
36b7dde
over 4 years ago
mc4
Adding sampling to mc4
over 4 years ago
.gitattributes
Safe
690 Bytes
initial commit
over 4 years ago
.gitignore
Safe
1.84 kB
Initial test with BETO's corpus
over 4 years ago
README.md
1.84 kB
Adding checkpointing, wandb, and new mlm script
over 4 years ago
config.json
Safe
619 Bytes
Initial test with BETO's corpus
over 4 years ago
config.py
247 Bytes
Scripts for perplexity sampling and fixes
over 4 years ago
convert.py
458 Bytes
Scripts for perplexity sampling and fixes
over 4 years ago
flax_model.msgpack
712 MB
xet
Adding correct models 10k steps
over 4 years ago
get_embeddings_and_perplexity.py
Safe
1.53 kB
Add script to generate dataset of embeddings and perplexities. Add script to generate t-SNE plot for embedding and perplexity visualization.
over 4 years ago
perplexity.py
Safe
751 Bytes
Adding checkpointing, wandb, and new mlm script
over 4 years ago
pytorch_model.bin
1.42 GB
xet
Adding correct models 10k steps
over 4 years ago
run.sh
978 Bytes
Updating run script
over 4 years ago
run_mlm_flax.py
Safe
30 kB
Adding sampling to mc4
over 4 years ago
run_mlm_flax_stream.py
28 kB
Adding sampling to mc4
over 4 years ago
run_stream.sh
928 Bytes
Adding sampling to mc4
over 4 years ago
tokenizer.json
Safe
1.47 MB
New tokenizer
over 4 years ago
tokens.py
Safe
649 Bytes
Scripts for perplexity sampling and fixes
over 4 years ago
tokens.py.orig
Safe
899 Bytes
Adjust batch size for extrating tokens
over 4 years ago
tsne_plot.py
Safe
3.02 kB
Remove unused imports
over 4 years ago
