Spaces:
Sleeping
Sleeping
Update app.py
Browse files
app.py
CHANGED
@@ -20,26 +20,18 @@ HF_INPUT_DATASET_URL_COLUMN = os.getenv("HF_INPUT_DATASET_URL_COLUMN")
|
|
20 |
HF_OUTPUT_DATASET = os.getenv("HF_OUTPUT_DATASET")
|
21 |
HF_OUTPUT_DATASET_DIR = os.getenv("HF_OUTPUT_DATASET_DIR")
|
22 |
INSTRUCTIONS = """
|
23 |
-
#
|
|
|
24 |
|
25 |
-
|
|
|
|
|
|
|
|
|
26 |
|
27 |
-
|
28 |
-
* Add a `HF_TOKEN` secret in the Space settings (it saves the results to a given dataset, so it requires write access)
|
29 |
-
* Set the environment variables in the [`.env`](https://huggingface.co/spaces/saridormi/labeling-template/blob/main/.env) file to point to correct datasets/columns/paths for your input and output data
|
30 |
-
* Adjust `INSTRUCTIONS` (it's what's rendered here) and `SAVE_EVERY_N_EXAMPLES` (how often should answers be saved to the output dataset) in the [`app.py`](https://huggingface.co/spaces/saridormi/labeling-template/blob/main/app.py) file
|
31 |
-
|
32 |
-
Done! 💛
|
33 |
-
|
34 |
-
### About:
|
35 |
-
|
36 |
-
Please compare the two model outputs shown below and select which one you think is better.
|
37 |
-
- Choose "A is better" if the output from Model A (left) is superior
|
38 |
-
- Choose "B is better" if the output from Model B (right) is superior
|
39 |
-
- Choose "Tie" if they are equally good or bad
|
40 |
-
- Choose "Can't choose" if you cannot make a determination
|
41 |
"""
|
42 |
-
SAVE_EVERY_N_EXAMPLES =
|
43 |
|
44 |
|
45 |
class PairwiseLabeler:
|
|
|
20 |
HF_OUTPUT_DATASET = os.getenv("HF_OUTPUT_DATASET")
|
21 |
HF_OUTPUT_DATASET_DIR = os.getenv("HF_OUTPUT_DATASET_DIR")
|
22 |
INSTRUCTIONS = """
|
23 |
+
# ⚔️ Which Documentation Is Better?
|
24 |
+
Please compare two given module documentations and select which one you think is better.
|
25 |
|
26 |
+
Choose "A is better" if the output from Model A (left) is superior
|
27 |
+
Choose "B is better" if the output from Model B (right) is superior
|
28 |
+
Choose "Tie" if they are equally good or bad
|
29 |
+
Choose "Can't choose" if you cannot make a decision
|
30 |
+
Refer to the GitHub URL to the module code if you find it hard to judge based just on documentation alone.
|
31 |
|
32 |
+
Thank you! 💛
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
33 |
"""
|
34 |
+
SAVE_EVERY_N_EXAMPLES = 3
|
35 |
|
36 |
|
37 |
class PairwiseLabeler:
|