ficsort's picture
Update README.md
6d333de
|
raw
history blame
574 Bytes
metadata
language: hu
license: apache-2.0
datasets:
  - wikipedia
tags:
  - generated_from_keras_callback
  - hubert
model-index:
  - name: hubert-tiny-wiki-seq128
    results: []

hubert-tiny-wiki-seq128

This model was trained from scratch on the Wikipedia subset of Hungarian Webcorpus 2.0 with MLM and SOP tasks.

Framework versions

  • Transformers 4.21.3
  • TensorFlow 2.10.0
  • Datasets 2.4.0
  • Tokenizers 0.12.1

Acknowledgement

Artificial Intelligence - National Laboratory - Hungary