Spaces:
Paused
Paused
<!--โ ๏ธ Note that this file is in Markdown but contain specific syntax for our doc-builder (similar to MDX) that may not be | |
rendered properly in your Markdown viewer. | |
--> | |
# ์ปค๋ฎค๋ํฐ [[community]] | |
์ด ํ์ด์ง๋ ์ปค๋ฎค๋ํฐ์์ ๊ฐ๋ฐํ ๐ค Transformers ๋ฆฌ์์ค๋ฅผ ์ฌ๊ตฌ์ฑํ ํ์ด์ง์ ๋๋ค. | |
## ์ปค๋ฎค๋ํฐ ๋ฆฌ์์ค: [[community-resources]] | |
| ๋ฆฌ์์ค | ์ค๋ช | ๋ง๋ ์ด | | |
|:----------|:-------------|------:| | |
| [Hugging Face Transformers ์ฉ์ด์ง ํ๋์์นด๋](https://www.darigovresearch.com/huggingface-transformers-glossary-flashcards) | [Transformers ๋ฌธ์ ์ฉ์ด์ง](glossary)์ ๊ธฐ๋ฐ์ผ๋ก ํ ํ๋์์นด๋ ์ธํธ๋ก, ์ง์์ ์ฅ๊ธฐ์ ์ผ๋ก ์ ์งํ๊ธฐ ์ํด ํน๋ณํ ์ค๊ณ๋ ์คํ์์ค ํฌ๋ก์ค ํ๋ซํผ ์ฑ์ธ [Anki](https://apps.ankiweb.net/)๋ฅผ ์ฌ์ฉํ์ฌ ์ฝ๊ฒ ํ์ต/์์ ํ ์ ์๋ ํํ๋ก ์ ์๋์์ต๋๋ค. [ํ๋์์นด๋ ์ฌ์ฉ๋ฒ์ ๋ํ ์๊ฐ ๋์์](https://www.youtube.com/watch?v=Dji_h7PILrw)์ ์ฐธ์กฐํ์ธ์. | [Darigov ๋ฆฌ์์น](https://www.darigovresearch.com/) | | |
## ์ปค๋ฎค๋ํฐ ๋ ธํธ๋ถ: [[community-notebooks]] | |
| ๋ ธํธ๋ถ | ์ค๋ช | ๋ง๋ ์ด | | | |
|:----------|:-------------|:-------------|------:| | |
| [๊ฐ์ฌ๋ฅผ ์์ฑํ๊ธฐ ์ํด ์ฌ์ ํ๋ จ๋ ํธ๋์คํฌ๋จธ๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/AlekseyKorshuk/huggingartists) | GPT-2 ๋ชจ๋ธ์ ๋ฏธ์ธ ์กฐ์ ํ์ฌ ์ข์ํ๋ ์ํฐ์คํธ์ ์คํ์ผ๋ก ๊ฐ์ฌ๋ฅผ ์์ฑํ๋ ๋ฐฉ๋ฒ | [Aleksey Korshuk](https://github.com/AlekseyKorshuk) | [](https://colab.research.google.com/github/AlekseyKorshuk/huggingartists/blob/master/huggingartists-demo.ipynb) | | |
| [Tensorflow 2๋ก T5 ํ๋ จํ๊ธฐ](https://github.com/snapthat/TF-T5-text-to-text) | Tensorflow 2๋ฅผ ์ฌ์ฉํ์ฌ T5๋ฅผ ํ๋ จ์ํค๋ ๋ฐฉ๋ฒ. ์ด ๋ ธํธ๋ถ์ Tensorflow 2๋ก SQUAD๋ฅผ ์ฌ์ฉํ์ฌ ๊ตฌํํ ์ง์์๋ต ์์ ์ ๋ณด์ฌ์ค๋๋ค. | [Muhammad Harris](https://github.com/HarrisDePerceptron) |[](https://colab.research.google.com/github/snapthat/TF-T5-text-to-text/blob/master/snapthatT5/notebooks/TF-T5-Datasets%20Training.ipynb) | | |
| [TPU์์ T5 ํ๋ จํ๊ธฐ](https://github.com/patil-suraj/exploring-T5/blob/master/T5_on_TPU.ipynb) | Transformers์ Nlp๋ฅผ ์ฌ์ฉํ์ฌ SQUAD๋ก T5๋ฅผ ํ๋ จํ๋ ๋ฐฉ๋ฒ | [Suraj Patil](https://github.com/patil-suraj) |[](https://colab.research.google.com/github/patil-suraj/exploring-T5/blob/master/T5_on_TPU.ipynb#scrollTo=QLGiFCDqvuil) | | |
| [๋ถ๋ฅ ๋ฐ ๊ฐ๊ด์ ๋ฌธ์ ๋ฅผ ์ํด T5 ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/patil-suraj/exploring-T5/blob/master/t5_fine_tuning.ipynb) | ๋ถ๋ฅ ๋ฐ ๊ฐ๊ด์ ๋ฌธ์ ์ ๋ง๊ฒ ํ ์คํธ-ํ ์คํธ ํ์์ ์ฌ์ฉํ์ฌ PyTorch Lightning์ผ๋ก T5๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Suraj Patil](https://github.com/patil-suraj) | [](https://colab.research.google.com/github/patil-suraj/exploring-T5/blob/master/t5_fine_tuning.ipynb) | | |
| [์๋ก์ด ๋ฐ์ดํฐ ์ธํธ์ ์ธ์ด๋ก DialoGPT ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/ncoop57/i-am-a-nerd/blob/master/_notebooks/2020-05-12-chatbot-part-1.ipynb) | ์์ ๋ํํ ์ฑ๋ด์ ๋ง๋ค๊ธฐ ์ํด ์๋ก์ด ๋ฐ์ดํฐ ์ธํธ๋ก DialoGPT ๋ชจ๋ธ์ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Nathan Cooper](https://github.com/ncoop57) | [](https://colab.research.google.com/github/ncoop57/i-am-a-nerd/blob/master/_notebooks/2020-05-12-chatbot-part-1.ipynb) | | |
| [Reformer๋ก ๊ธด ์ํ์ค ๋ชจ๋ธ๋งํ๊ธฐ](https://github.com/patrickvonplaten/notebooks/blob/master/PyTorch_Reformer.ipynb) | Reformer๋ก ์ต๋ 50๋ง ํ ํฐ์ ์ํ์ค๋ฅผ ํ๋ จํ๋ ๋ฐฉ๋ฒ | [Patrick von Platen](https://github.com/patrickvonplaten) | [](https://colab.research.google.com/github/patrickvonplaten/notebooks/blob/master/PyTorch_Reformer.ipynb) | | |
| [์์ฝ์ ์ํด BART ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/ohmeow/ohmeow_website/blob/master/posts/2021-05-25-mbart-sequence-classification-with-blurr.ipynb) | blurr๋ฅผ ์ฌ์ฉํ์ฌ fastai๋ก ์์ฝํ๊ธฐ ์ํด BART๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Wayde Gilliam](https://ohmeow.com/) | [](https://colab.research.google.com/github/ohmeow/ohmeow_website/blob/master/posts/2021-05-25-mbart-sequence-classification-with-blurr.ipynb) | | |
| [๋ค๋ฅธ ์ฌ๋์ ํธ์์ผ๋ก ์ฌ์ ํ๋ จ๋ ํธ๋์คํฌ๋จธ ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://colab.research.google.com/github/borisdayma/huggingtweets/blob/master/huggingtweets-demo.ipynb) | GPT-2 ๋ชจ๋ธ์ ๋ฏธ์ธ ์กฐ์ ํ์ฌ ์ข์ํ๋ ํธ์ํฐ ๊ณ์ ์คํ์ผ๋ก ํธ์์ ์์ฑํ๋ ๋ฐฉ๋ฒ | [Boris Dayma](https://github.com/borisdayma) | [](https://colab.research.google.com/github/borisdayma/huggingtweets/blob/master/huggingtweets-demo.ipynb) | | |
| [Weights & Biases๋ก ๐ค Hugging Face ๋ชจ๋ธ ์ต์ ํํ๊ธฐ](https://colab.research.google.com/github/wandb/examples/blob/master/colabs/huggingface/Optimize_Hugging_Face_models_with_Weights_%26_Biases.ipynb) | W&B์ Hugging Face์ ํตํฉ์ ๋ณด์ฌ์ฃผ๋ ์ ์ฒด ํํ ๋ฆฌ์ผ | [Boris Dayma](https://github.com/borisdayma) | [](https://colab.research.google.com/github/wandb/examples/blob/master/colabs/huggingface/Optimize_Hugging_Face_models_with_Weights_%26_Biases.ipynb) | | |
| [Longformer ์ฌ์ ํ๋ จํ๊ธฐ](https://github.com/allenai/longformer/blob/master/scripts/convert_model_to_long.ipynb) | ๊ธฐ์กด ์ฌ์ ํ๋ จ๋ ๋ชจ๋ธ์ "๊ธด" ๋ฒ์ ์ ๋น๋ํ๋ ๋ฐฉ๋ฒ | [Iz Beltagy](https://beltagy.net) | [](https://colab.research.google.com/github/allenai/longformer/blob/master/scripts/convert_model_to_long.ipynb) | | |
| [QA๋ฅผ ์ํด Longformer ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/patil-suraj/Notebooks/blob/master/longformer_qa_training.ipynb) | QA ์์ ์ ์ํด Longformer๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Suraj Patil](https://github.com/patil-suraj) | [](https://colab.research.google.com/github/patil-suraj/Notebooks/blob/master/longformer_qa_training.ipynb) | | |
| [๐ค Nlp๋ก ๋ชจ๋ธ ํ๊ฐํ๊ธฐ](https://github.com/patrickvonplaten/notebooks/blob/master/How_to_evaluate_Longformer_on_TriviaQA_using_NLP.ipynb) | `Nlp`๋ก TriviaQA์์ Longformer๋ฅผ ํ๊ฐํ๋ ๋ฐฉ๋ฒ | [Patrick von Platen](https://github.com/patrickvonplaten) | [](https://colab.research.google.com/drive/1m7eTGlPmLRgoPkkA7rkhQdZ9ydpmsdLE?usp=sharing) | | |
| [๊ฐ์ ๋ฒ์ ์ถ์ถ์ ์ํด T5 ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/enzoampil/t5-intro/blob/master/t5_qa_training_pytorch_span_extraction.ipynb) | ๊ฐ์ ๋ฒ์ ์ถ์ถ์ ์ํด ํ ์คํธ-ํ ์คํธ ํ์์ ์ฌ์ฉํ์ฌ PyTorch Lightning์ผ๋ก T5๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Lorenzo Ampil](https://github.com/enzoampil) | [](https://colab.research.google.com/github/enzoampil/t5-intro/blob/master/t5_qa_training_pytorch_span_extraction.ipynb) | | |
| [๋ค์ค ํด๋์ค ๋ถ๋ฅ๋ฅผ ์ํด DistilBert ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/abhimishra91/transformers-tutorials/blob/master/transformers_multiclass_classification.ipynb) | ๋ค์ค ํด๋์ค ๋ถ๋ฅ๋ฅผ ์ํด PyTorch๋ฅผ ์ฌ์ฉํ์ฌ DistilBert๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Abhishek Kumar Mishra](https://github.com/abhimishra91) | [](https://colab.research.google.com/github/abhimishra91/transformers-tutorials/blob/master/transformers_multiclass_classification.ipynb)| | |
| [๋ค์ค ๋ ์ด๋ธ ๋ถ๋ฅ๋ฅผ ์ํด BERT ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/abhimishra91/transformers-tutorials/blob/master/transformers_multi_label_classification.ipynb) | ๋ค์ค ๋ ์ด๋ธ ๋ถ๋ฅ๋ฅผ ์ํด PyTorch๋ฅผ ์ฌ์ฉํ์ฌ BERT๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Abhishek Kumar Mishra](https://github.com/abhimishra91) | [](https://colab.research.google.com/github/abhimishra91/transformers-tutorials/blob/master/transformers_multi_label_classification.ipynb)| | |
| [์์ฝ์ ์ํด T5 ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/abhimishra91/transformers-tutorials/blob/master/transformers_summarization_wandb.ipynb) | ์์ฝ์ ์ํด PyTorch๋ก T5๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๊ณ WandB๋ก ์คํ์ ์ถ์ ํ๋ ๋ฐฉ๋ฒ | [Abhishek Kumar Mishra](https://github.com/abhimishra91) | [](https://colab.research.google.com/github/abhimishra91/transformers-tutorials/blob/master/transformers_summarization_wandb.ipynb)| | |
| [๋์ ํจ๋ฉ/๋ฒ์ผํ ์ผ๋ก Transformers ๋ฏธ์ธ ์กฐ์ ์๋ ๋์ด๊ธฐ](https://github.com/ELS-RD/transformers-notebook/blob/master/Divide_Hugging_Face_Transformers_training_time_by_2_or_more.ipynb)| ๋์ ํจ๋ฉ/๋ฒ์ผํ ์ ์ฌ์ฉํ์ฌ ๋ฏธ์ธ ์กฐ์ ์๋๋ฅผ 2๋ฐฐ๋ก ๋์ด๋ ๋ฐฉ๋ฒ |[Michael Benesty](https://github.com/pommedeterresautee) |[](https://colab.research.google.com/drive/1CBfRU1zbfu7-ijiOqAAQUA-RJaxfcJoO?usp=sharing)| | |
|[๋ง์คํน๋ ์ธ์ด ๋ชจ๋ธ๋ง์ ์ํด Reformer ์ฌ์ ํ๋ จํ๊ธฐ](https://github.com/patrickvonplaten/notebooks/blob/master/Reformer_For_Masked_LM.ipynb)| ์๋ฐฉํฅ ์ ํ ์ดํ ์ ๋ ์ด์ด๋ฅผ ์ด์ฉํด์ Reformer ๋ชจ๋ธ์ ํ๋ จํ๋ ๋ฐฉ๋ฒ | [Patrick von Platen](https://github.com/patrickvonplaten) | [](https://colab.research.google.com/drive/1tzzh0i8PgDQGV3SMFUGxM7_gGae3K-uW?usp=sharing)| | |
| [Sci-BERT ํ์ฅ ๋ฐ ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/lordtt13/word-embeddings/blob/master/COVID-19%20Research%20Data/COVID-SciBERT.ipynb)| CORD ๋ฐ์ดํฐ ์ธํธ๋ก AllenAI์์ ์ฌ์ ํ๋ จ๋ SciBERT ๋ชจ๋ธ์ ์ดํ๋ฅผ ๋๋ฆฌ๊ณ ํ์ดํ๋ผ์ธ์ ๊ตฌ์ถํ๋ ๋ฐฉ๋ฒ | [Tanmay Thakur](https://github.com/lordtt13) | [](https://colab.research.google.com/drive/1rqAR40goxbAfez1xvF3hBJphSCsvXmh8)| | |
| [์์ฝ์ ์ํด Trainer API๋ก BlenderBotSmall ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/lordtt13/transformers-experiments/blob/master/Custom%20Tasks/fine-tune-blenderbot_small-for-summarization.ipynb)| ์์ฝ์ ์ํด Trainer API๋ฅผ ์ฌ์ฉํ์ฌ ์ฌ์ฉ์ ์ง์ ๋ฐ์ดํฐ ์ธํธ๋ก BlenderBotSmall ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ | [Tanmay Thakur](https://github.com/lordtt13) | [](https://colab.research.google.com/drive/19Wmupuls7mykSGyRN_Qo6lPQhgp56ymq?usp=sharing)| | |
| [ํตํฉ ๊ธฐ์ธ๊ธฐ(Integrated Gradient)๋ฅผ ์ด์ฉํ์ฌ Electra ๋ฏธ์ธ ์กฐ์ ํ๊ณ ํด์ํ๊ธฐ](https://github.com/elsanns/xai-nlp-notebooks/blob/master/electra_fine_tune_interpret_captum_ig.ipynb) | ๊ฐ์ ๋ถ์์ ์ํด Electra๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๊ณ Captum ํตํฉ ๊ธฐ์ธ๊ธฐ๋ก ์์ธก์ ํด์ํ๋ ๋ฐฉ๋ฒ | [Eliza Szczechla](https://elsanns.github.io) | [](https://colab.research.google.com/github/elsanns/xai-nlp-notebooks/blob/master/electra_fine_tune_interpret_captum_ig.ipynb)| | |
| [Trainer ํด๋์ค๋ก ๋น์์ด๊ถ GPT-2 ๋ชจ๋ธ ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/philschmid/fine-tune-GPT-2/blob/master/Fine_tune_a_non_English_GPT_2_Model_with_Huggingface.ipynb) | Trainer ํด๋์ค๋ก ๋น์์ด๊ถ GPT-2 ๋ชจ๋ธ์ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Philipp Schmid](https://www.philschmid.de) | [](https://colab.research.google.com/github/philschmid/fine-tune-GPT-2/blob/master/Fine_tune_a_non_English_GPT_2_Model_with_Huggingface.ipynb)| | |
|[๋ค์ค ๋ผ๋ฒจ ๋ถ๋ฅ ์์ ์ ์ํด DistilBERT ๋ชจ๋ธ ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/DhavalTaunk08/Transformers_scripts/blob/master/Transformers_multilabel_distilbert.ipynb) | ๋ค์ค ๋ผ๋ฒจ ๋ถ๋ฅ ์์ ์ ์ํด DistilBERT ๋ชจ๋ธ์ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Dhaval Taunk](https://github.com/DhavalTaunk08) | [](https://colab.research.google.com/github/DhavalTaunk08/Transformers_scripts/blob/master/Transformers_multilabel_distilbert.ipynb)| | |
|[๋ฌธ์ฅ์ ๋ถ๋ฅ๋ฅผ ์ํด ALBERT ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/NadirEM/nlp-notebooks/blob/master/Fine_tune_ALBERT_sentence_pair_classification.ipynb) | ๋ฌธ์ฅ์ ๋ถ๋ฅ ์์ ์ ์ํด ALBERT ๋ชจ๋ธ ๋๋ ๋ค๋ฅธ BERT ๊ธฐ๋ฐ ๋ชจ๋ธ์ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Nadir El Manouzi](https://github.com/NadirEM) | [](https://colab.research.google.com/github/NadirEM/nlp-notebooks/blob/master/Fine_tune_ALBERT_sentence_pair_classification.ipynb)| | |
|[๊ฐ์ ๋ถ์์ ์ํด Roberta ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/DhavalTaunk08/NLP_scripts/blob/master/sentiment_analysis_using_roberta.ipynb) | ๊ฐ์ ๋ถ์์ ์ํด Roberta ๋ชจ๋ธ์ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Dhaval Taunk](https://github.com/DhavalTaunk08) | [](https://colab.research.google.com/github/DhavalTaunk08/NLP_scripts/blob/master/sentiment_analysis_using_roberta.ipynb)| | |
|[์ง๋ฌธ ์์ฑ ๋ชจ๋ธ ํ๊ฐํ๊ธฐ](https://github.com/flexudy-pipe/qugeev) | seq2seq ํธ๋์คํฌ๋จธ ๋ชจ๋ธ์ด ์์ฑํ ์ง๋ฌธ๊ณผ ์ด์ ๋ํ ๋ต๋ณ์ด ์ผ๋ง๋ ์ ํํ๊ฐ์? | [Pascal Zoleko](https://github.com/zolekode) | [](https://colab.research.google.com/drive/1bpsSqCQU-iw_5nNoRm_crPq6FRuJthq_?usp=sharing)| | |
|[DistilBERT์ Tensorflow๋ก ํ ์คํธ ๋ถ๋ฅํ๊ธฐ](https://github.com/peterbayerle/huggingface_notebook/blob/main/distilbert_tf.ipynb) | ํ ์คํธ ๋ถ๋ฅ๋ฅผ ์ํด TensorFlow๋ก DistilBERT๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Peter Bayerle](https://github.com/peterbayerle) | [](https://colab.research.google.com/github/peterbayerle/huggingface_notebook/blob/main/distilbert_tf.ipynb)| | |
|[CNN/Dailail ์์ฝ์ ์ํด ์ธ์ฝ๋-๋์ฝ๋ ๋ชจ๋ธ์ BERT ํ์ฉํ๊ธฐ](https://github.com/patrickvonplaten/notebooks/blob/master/BERT2BERT_for_CNN_Dailymail.ipynb) | CNN/Dailail ์์ฝ์ ์ํด *bert-base-uncased* ์ฒดํฌํฌ์ธํธ๋ฅผ ํ์ฉํ์ฌ *EncoderDecoderModel*์ ์๋ฐ์ ํ๋ ๋ฐฉ๋ฒ | [Patrick von Platen](https://github.com/patrickvonplaten) | [](https://colab.research.google.com/github/patrickvonplaten/notebooks/blob/master/BERT2BERT_for_CNN_Dailymail.ipynb)| | |
|[BBC XSum ์์ฝ์ ์ํด ์ธ์ฝ๋-๋์ฝ๋ ๋ชจ๋ธ์ RoBERTa ํ์ฉํ๊ธฐ](https://github.com/patrickvonplaten/notebooks/blob/master/RoBERTaShared_for_BBC_XSum.ipynb) | BBC/XSum ์์ฝ์ ์ํด *roberta-base* ์ฒดํฌํฌ์ธํธ๋ฅผ ํ์ฉํ์ฌ ๊ณต์ *EncoderDecoderModel*์ ์๋ฐ์ ํ๋ ๋ฐฉ๋ฒ | [Patrick von Platen](https://github.com/patrickvonplaten) | [](https://colab.research.google.com/github/patrickvonplaten/notebooks/blob/master/RoBERTaShared_for_BBC_XSum.ipynb)| | |
|[์์ฐจ์ ์ง๋ฌธ ๋ต๋ณ(SQA)์ ์ํด TAPAS ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/NielsRogge/Transformers-Tutorials/blob/master/TAPAS/Fine_tuning_TapasForQuestionAnswering_on_SQA.ipynb) | *tapas-base* ์ฒดํฌํฌ์ธํธ๋ฅผ ํ์ฉํ์ฌ ์์ฐจ์ ์ง๋ฌธ ๋ต๋ณ(SQA) ๋ฐ์ดํฐ ์ธํธ๋ก *TapasForQuestionAnswering*์ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Niels Rogge](https://github.com/nielsrogge) | [](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/TAPAS/Fine_tuning_TapasForQuestionAnswering_on_SQA.ipynb)| | |
|[ํ ์ฌ์ค ๊ฒ์ฌ(TabFact)๋ก TAPAS ํ๊ฐํ๊ธฐ](https://github.com/NielsRogge/Transformers-Tutorials/blob/master/TAPAS/Evaluating_TAPAS_on_the_Tabfact_test_set.ipynb) | ๐ค Datasets์ ๐ค Transformer ๋ผ์ด๋ธ๋ฌ๋ฆฌ๋ฅผ ํจ๊ป ์ฌ์ฉํ์ฌ *tapas-base-finetuned-tabfact* ์ฒดํฌํฌ์ธํธ๋ก ๋ฏธ์ธ ์กฐ์ ๋ *TapasForSequenceClassification*์ ํ๊ฐํ๋ ๋ฐฉ๋ฒ | [Niels Rogge](https://github.com/nielsrogge) | [](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/TAPAS/Evaluating_TAPAS_on_the_Tabfact_test_set.ipynb)| | |
|[๋ฒ์ญ์ ์ํด mBART ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://colab.research.google.com/github/vasudevgupta7/huggingface-tutorials/blob/main/translation_training.ipynb) | ํ๋์ด์์ ์์ด๋ก ๋ฒ์ญํ๊ธฐ ์ํด Seq2SeqTrainer๋ฅผ ์ฌ์ฉํ์ฌ mBART๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Vasudev Gupta](https://github.com/vasudevgupta7) | [](https://colab.research.google.com/github/vasudevgupta7/huggingface-tutorials/blob/main/translation_training.ipynb)| | |
|[FUNSD(์์ ์ดํด ๋ฐ์ดํฐ ์ธํธ)๋ก LayoutLM ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/NielsRogge/Transformers-Tutorials/blob/master/LayoutLM/Fine_tuning_LayoutLMForTokenClassification_on_FUNSD.ipynb) | ์ค์บํ ๋ฌธ์์์ ์ ๋ณด ์ถ์ถ์ ์ํด FUNSD ๋ฐ์ดํฐ ์ธํธ๋ก *LayoutLMForTokenClassification*์ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Niels Rogge](https://github.com/nielsrogge) | [](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/LayoutLM/Fine_tuning_LayoutLMForTokenClassification_on_FUNSD.ipynb)| | |
|[DistilGPT2 ๋ฏธ์ธ ์กฐ์ ํ๊ณ ๋ฐ ํ ์คํธ ์์ฑํ๊ธฐ](https://colab.research.google.com/github/tripathiaakash/DistilGPT2-Tutorial/blob/main/distilgpt2_fine_tuning.ipynb) | DistilGPT2๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๊ณ ํ ์คํธ๋ฅผ ์์ฑํ๋ ๋ฐฉ๋ฒ | [Aakash Tripathi](https://github.com/tripathiaakash) | [](https://colab.research.google.com/github/tripathiaakash/DistilGPT2-Tutorial/blob/main/distilgpt2_fine_tuning.ipynb)| | |
|[์ต๋ 8K ํ ํฐ์์ LED ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/patrickvonplaten/notebooks/blob/master/Fine_tune_Longformer_Encoder_Decoder_(LED)_for_Summarization_on_pubmed.ipynb) | ๊ธด ๋ฒ์๋ฅผ ์์ฝํ๊ธฐ ์ํด PubMed๋ก LED๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Patrick von Platen](https://github.com/patrickvonplaten) | [](https://colab.research.google.com/github/patrickvonplaten/notebooks/blob/master/Fine_tune_Longformer_Encoder_Decoder_(LED)_for_Summarization_on_pubmed.ipynb)| | |
|[Arxiv๋ก LED ํ๊ฐํ๊ธฐ](https://github.com/patrickvonplaten/notebooks/blob/master/LED_on_Arxiv.ipynb) | ๊ธด ๋ฒ์ ์์ฝ์ ๋ํด LED๋ฅผ ํจ๊ณผ์ ์ผ๋ก ํ๊ฐํ๋ ๋ฐฉ๋ฒ | [Patrick von Platen](https://github.com/patrickvonplaten) | [](https://colab.research.google.com/github/patrickvonplaten/notebooks/blob/master/LED_on_Arxiv.ipynb)| | |
|[RVL-CDIP(๋ฌธ์ ์ด๋ฏธ์ง ๋ถ๋ฅ ๋ฐ์ดํฐ ์ธํธ)๋ก LayoutLM ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ)](https://github.com/NielsRogge/Transformers-Tutorials/blob/master/LayoutLM/Fine_tuning_LayoutLMForSequenceClassification_on_RVL_CDIP.ipynb) | ์ค์บ ๋ฌธ์ ๋ถ๋ฅ๋ฅผ ์ํด RVL-CDIP ๋ฐ์ดํฐ ์ธํธ๋ก *LayoutLMForSequenceClassification*์ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Niels Rogge](https://github.com/nielsrogge) | [](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/LayoutLM/Fine_tuning_LayoutLMForSequenceClassification_on_RVL_CDIP.ipynb)| | |
|[GPT2 ์กฐ์ ์ ํตํ Wav2Vec2 CTC ๋์ฝ๋ฉ](https://github.com/voidful/huggingface_notebook/blob/main/xlsr_gpt.ipynb) | ์ธ์ด ๋ชจ๋ธ ์กฐ์ ์ ํตํด CTC ์ํ์ค๋ฅผ ๋์ฝ๋ฉํ๋ ๋ฐฉ๋ฒ | [Eric Lam](https://github.com/voidful) | [](https://colab.research.google.com/drive/1e_z5jQHYbO2YKEaUgzb1ww1WwiAyydAj?usp=sharing)| | |
|[Trainer ํด๋์ค๋ก ๋ ๊ฐ ์ธ์ด๋ก ์์ฝํ๊ธฐ ์ํด BART ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/elsanns/xai-nlp-notebooks/blob/master/fine_tune_bart_summarization_two_langs.ipynb) | Trainer ํด๋์ค๋ก ๋ ๊ฐ ์ธ์ด๋ก ์์ฝํ๊ธฐ ์ํด BART ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Eliza Szczechla](https://github.com/elsanns) | [](https://colab.research.google.com/github/elsanns/xai-nlp-notebooks/blob/master/fine_tune_bart_summarization_two_langs.ipynb)| | |
|[Trivia QA๋ก Big Bird ํ๊ฐํ๊ธฐ](https://github.com/patrickvonplaten/notebooks/blob/master/Evaluating_Big_Bird_on_TriviaQA.ipynb) | Trivia QA๋ก ๊ธด ๋ฌธ์ ์ง๋ฌธ์ ๋ํ ๋ต๋ณ์ ๋ํด BigBird๋ฅผ ํ๊ฐํ๋ ๋ฐฉ๋ฒ | [Patrick von Platen](https://github.com/patrickvonplaten) | [](https://colab.research.google.com/github/patrickvonplaten/notebooks/blob/master/Evaluating_Big_Bird_on_TriviaQA.ipynb)| | |
| [Wav2Vec2๋ฅผ ์ฌ์ฉํ์ฌ ๋์์ ์บก์ ๋ง๋ค๊ธฐ](https://github.com/Muennighoff/ytclipcc/blob/main/wav2vec_youtube_captions.ipynb) | Wav2Vec์ผ๋ก ์ค๋์ค๋ฅผ ํ ์คํธ๋ก ๋ณํํ์ฌ ๋ชจ๋ ๋์์์์ YouTube ์บก์ ๋ง๋๋ ๋ฐฉ๋ฒ | [Niklas Muennighoff](https://github.com/Muennighoff) |[](https://colab.research.google.com/github/Muennighoff/ytclipcc/blob/main/wav2vec_youtube_captions.ipynb) | | |
| [PyTorch Lightning์ ์ฌ์ฉํ์ฌ CIFAR-10์ผ๋ก ๋น์ ํธ๋์คํฌ๋จธ ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/NielsRogge/Transformers-Tutorials/blob/master/VisionTransformer/Fine_tuning_the_Vision_Transformer_on_CIFAR_10_with_PyTorch_Lightning.ipynb) | HuggingFace Transformers, Datasets, PyTorch Lightning์ ์ฌ์ฉํ์ฌ CIFAR-10์ผ๋ก ๋น์ ํธ๋์คํฌ๋จธ(ViT)๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Niels Rogge](https://github.com/nielsrogge) |[](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/VisionTransformer/Fine_tuning_the_Vision_Transformer_on_CIFAR_10_with_PyTorch_Lightning.ipynb) | | |
| [๐ค Trainer๋ฅผ ์ฌ์ฉํ์ฌ CIFAR-10์์ ๋น์ ํธ๋์คํฌ๋จธ ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/NielsRogge/Transformers-Tutorials/blob/master/VisionTransformer/Fine_tuning_the_Vision_Transformer_on_CIFAR_10_with_the_%F0%9F%A4%97_Trainer.ipynb) | Datasets, ๐ค Trainer๋ฅผ ์ฌ์ฉํ์ฌ CIFAR-10์์ ๋น์ ํธ๋์คํฌ๋จธ(ViT)๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Niels Rogge](https://github.com/nielsrogge) |[](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/VisionTransformer/Fine_tuning_the_Vision_Transformer_on_CIFAR_10_with_the_%F0%9F%A4%97_Trainer.ipynb) | | |
| [๊ฐ์ฒด ์ ๋ ฅ ๋ฐ์ดํฐ ์ธํธ์ธ Open Entity๋ก LUKE ํ๊ฐํ๊ธฐ](https://github.com/studio-ousia/luke/blob/master/notebooks/huggingface_open_entity.ipynb) | Open Entity ๋ฐ์ดํฐ ์ธํธ๋ก *LukeForEntityClassification*์ ํ๊ฐํ๋ ๋ฐฉ๋ฒ | [Ikuya Yamada](https://github.com/ikuyamada) |[](https://colab.research.google.com/github/studio-ousia/luke/blob/master/notebooks/huggingface_open_entity.ipynb) | | |
| [๊ด๊ณ ์ถ์ถ ๋ฐ์ดํฐ ์ธํธ์ธ TACRED๋ก LUKE ํ๊ฐํ๊ธฐ](https://github.com/studio-ousia/luke/blob/master/notebooks/huggingface_tacred.ipynb) | TACRED ๋ฐ์ดํฐ ์ธํธ๋ก *LukeForEntityPairClassification*์ ํ๊ฐํ๋ ๋ฐฉ๋ฒ | [Ikuya Yamada](https://github.com/ikuyamada) |[](https://colab.research.google.com/github/studio-ousia/luke/blob/master/notebooks/huggingface_tacred.ipynb) | | |
| [์ค์ NER ๋ฒค์น๋งํฌ์ธ CoNLL-2003์ผ๋ก LUKE ํ๊ฐํ๊ธฐ](https://github.com/studio-ousia/luke/blob/master/notebooks/huggingface_conll_2003.ipynb) | CoNLL-2003 ๋ฐ์ดํฐ ์ธํธ๋ก *LukeForEntitySpanClassification*๋ฅผ ํ๊ฐํ๋ ๋ฐฉ๋ฒ | [Ikuya Yamada](https://github.com/ikuyamada) |[](https://colab.research.google.com/github/studio-ousia/luke/blob/master/notebooks/huggingface_conll_2003.ipynb) | | |
| [PubMed ๋ฐ์ดํฐ ์ธํธ๋ก BigBird-Pegasus ํ๊ฐํ๊ธฐ](https://github.com/vasudevgupta7/bigbird/blob/main/notebooks/bigbird_pegasus_evaluation.ipynb) | PubMed ๋ฐ์ดํฐ ์ธํธ๋ก *BigBirdPegasusForConditionalGeneration*๋ฅผ ํ๊ฐํ๋ ๋ฐฉ๋ฒ | [Vasudev Gupta](https://github.com/vasudevgupta7) | [](https://colab.research.google.com/github/vasudevgupta7/bigbird/blob/main/notebooks/bigbird_pegasus_evaluation.ipynb) | | |
| [Wav2Vec2๋ฅผ ์ฌ์ฉํด์ ์์ฑ ๊ฐ์ ๋ถ๋ฅํ๊ธฐ](https://github/m3hrdadfi/soxan/blob/main/notebooks/Emotion_recognition_in_Greek_speech_using_Wav2Vec2.ipynb) | ๊ฐ์ ๋ถ๋ฅ๋ฅผ ์ํด ์ฌ์ ํ๋ จ๋ Wav2Vec2 ๋ชจ๋ธ์ MEGA ๋ฐ์ดํฐ ์ธํธ์ ํ์ฉํ๋ ๋ฐฉ๋ฒ | [Mehrdad Farahani](https://github.com/m3hrdadfi) | [](https://colab.research.google.com/github/m3hrdadfi/soxan/blob/main/notebooks/Emotion_recognition_in_Greek_speech_using_Wav2Vec2.ipynb) | | |
| [DETR๋ก ์ด๋ฏธ์ง์์ ๊ฐ์ฒด ํ์งํ๊ธฐ](https://github.com/NielsRogge/Transformers-Tutorials/blob/master/DETR/DETR_minimal_example_(with_DetrFeatureExtractor).ipynb) | ํ๋ จ๋ *DetrForObjectDetection* ๋ชจ๋ธ์ ์ฌ์ฉํ์ฌ ์ด๋ฏธ์ง์์ ๊ฐ์ฒด๋ฅผ ํ์งํ๊ณ ์ดํ ์ ์ ์๊ฐํํ๋ ๋ฐฉ๋ฒ | [Niels Rogge](https://github.com/NielsRogge) | [](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/DETR/DETR_minimal_example_(with_DetrFeatureExtractor).ipynb) | | |
| [์ฌ์ฉ์ ์ง์ ๊ฐ์ฒด ํ์ง ๋ฐ์ดํฐ ์ธํธ๋ก DETR ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/NielsRogge/Transformers-Tutorials/blob/master/DETR/Fine_tuning_DetrForObjectDetection_on_custom_dataset_(balloon).ipynb) | ์ฌ์ฉ์ ์ง์ ๊ฐ์ฒด ํ์ง ๋ฐ์ดํฐ ์ธํธ๋ก *DetrForObjectDetection*์ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Niels Rogge](https://github.com/NielsRogge) | [](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/DETR/Fine_tuning_DetrForObjectDetection_on_custom_dataset_(balloon).ipynb) | | |
| [๊ฐ์ฒด๋ช ์ธ์์ ์ํด T5 ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/ToluClassics/Notebooks/blob/main/T5_Ner_Finetuning.ipynb) | ๊ฐ์ฒด๋ช ์ธ์ ์์ ์ ์ํด *T5*๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Ogundepo Odunayo](https://github.com/ToluClassics) | [](https://colab.research.google.com/drive/1obr78FY_cBmWY5ODViCmzdY6O1KB65Vc?usp=sharing) | | |