Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
bertin-project
/
bertin-roberta-base-spanish
like
35
Follow
BERTIN Project
21
Fill-Mask
Transformers
PyTorch
JAX
TensorBoard
Safetensors
bertin-project/mc4-es-sampled
Spanish
roberta
spanish
Inference Endpoints
arxiv:
2207.06814
arxiv:
2107.07253
arxiv:
1907.11692
License:
cc-by-4.0
Model card
Files
Files and versions
Metrics
Training metrics
Community
1
Train
Deploy
Use this model
33bc718
bertin-roberta-base-spanish
8 contributors
History:
119 commits
Pablogps
Update README.md
33bc718
over 3 years ago
configs
Changed and added vocab and tokenizer
over 3 years ago
images
Adding possible logo
over 3 years ago
mc4
Fixing restore checkpoint step
over 3 years ago
utils
Explanations
over 3 years ago
.gitattributes
Safe
737 Bytes
initial commit
over 3 years ago
.gitignore
Safe
1.84 kB
Initial test with BETO's corpus
over 3 years ago
README.md
Safe
29.2 kB
Update README.md
over 3 years ago
config.json
Safe
618 Bytes
Fix config for checkpoint
over 3 years ago
config.py
Safe
256 Bytes
Preparing code for final runs
over 3 years ago
convert.py
Safe
876 Bytes
Improved version of conversion script Flax → PyTorch
over 3 years ago
events.out.tfevents.1625704081.t1v-n-a4d97d44-w-0.212075.3.v2
Safe
40 Bytes
LFS
Adding tfevents
over 3 years ago
events.out.tfevents.1625704245.t1v-n-a4d97d44-w-0.216676.3.v2
Safe
40 Bytes
LFS
Adding tfevents
over 3 years ago
events.out.tfevents.1625705283.t1v-n-a4d97d44-w-0.234462.3.v2
Safe
40 Bytes
LFS
Adding tfevents
over 3 years ago
flax_model.msgpack
Safe
250 MB
LFS
Model at 211k steps, mlm ac 0.6547
over 3 years ago
get_embeddings_and_perplexity.py
Safe
1.53 kB
Add script to generate dataset of embeddings and perplexities. Add script to generate t-SNE plot for embedding and perplexity visualization.
over 3 years ago
merges.txt
Safe
505 kB
Changed and added vocab and tokenizer
over 3 years ago
perplexity.py
Safe
751 Bytes
Adding checkpointing, wandb, and new mlm script
over 3 years ago
pytorch_model.bin
Safe
499 MB
LFS
Model at 211k steps, mlm ac 0.6547
over 3 years ago
run.sh
Safe
883 Bytes
Adding base config and organizing configs
over 3 years ago
run_mlm_flax.py
Safe
30 kB
Adding sampling to mc4
over 3 years ago
run_mlm_flax_stream.py
Safe
32.9 kB
Fixing restore checkpoint step
over 3 years ago
run_stream.sh
Safe
932 Bytes
Preparing code for final runs
over 3 years ago
special_tokens_map.json
Safe
239 Bytes
Changed and added vocab and tokenizer
over 3 years ago
tokenizer.json
Safe
1.45 MB
Changed and added vocab and tokenizer
over 3 years ago
tokenizer_config.json
Safe
292 Bytes
Changed and added vocab and tokenizer
over 3 years ago
tokens.py
Safe
649 Bytes
Scripts for perplexity sampling and fixes
over 3 years ago
tokens.py.orig
Safe
899 Bytes
Adjust batch size for extrating tokens
over 3 years ago
tsne_plot.py
Safe
3.02 kB
Remove unused imports
over 3 years ago
vocab.json
Safe
846 kB
Changed and added vocab and tokenizer
over 3 years ago
