Spaces:
Runtime error
Runtime error
Yuanjing Zhu
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -59,3 +59,22 @@ Things to do:
|
|
59 |
Due date: December 16, 2022
|
60 |
|
61 |
Demo - split up the workload so that it uses everybody’s best talents, not everyone has to present, break problem up so that final outcome is the best, one person really good at editing, can be editor, if one person is good at voiceocer then do the voiceover, if one person is good at documentation, then one person does documentation, if one person is doing coding, then one person is doing coding,
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
59 |
Due date: December 16, 2022
|
60 |
|
61 |
Demo - split up the workload so that it uses everybody’s best talents, not everyone has to present, break problem up so that final outcome is the best, one person really good at editing, can be editor, if one person is good at voiceocer then do the voiceover, if one person is good at documentation, then one person does documentation, if one person is doing coding, then one person is doing coding,
|
62 |
+
|
63 |
+
|
64 |
+
|
65 |
+
|
66 |
+
|
67 |
+
### Get Reddit data
|
68 |
+
* Data pulled in notebook `reddit_data/reddit_new.ipynb`
|
69 |
+
### Verify GPU works
|
70 |
+
* Run pytorch training test: `python utils/quickstart_pytorch.py`
|
71 |
+
* Run pytorch CUDA test: `python utils/verify_cuda_pytorch.py`
|
72 |
+
* Run tensorflow training test: `python utils/quickstart_tf2.py`
|
73 |
+
* Run nvidia monitoring test: `nvidia-smi -l 1`
|
74 |
+
|
75 |
+
### Finetune text classifier model and upload to Hugging Face
|
76 |
+
* In terminal, run `huggingface-cli login`
|
77 |
+
* Run `python fine_tune_berft.py` to finetune the model on Reddit data
|
78 |
+
* Run `rename_labels.py` to change the output labels of the classifier
|
79 |
+
* Check out the fine-tuned model [here](https://huggingface.co/michellejieli/inappropriate_text_classifier) [Spaces APP](https://huggingface.co/spaces/yjzhu0225/reddit_text_classification_app)
|
80 |
+
|