mtyrrell commited on
Commit
82c8dd7
·
1 Parent(s): a295957

Diagram update; sensitivity threshold change

Browse files
Files changed (2) hide show
  1. app.py +5 -5
  2. images/pipeline.png +0 -0
app.py CHANGED
@@ -83,12 +83,12 @@ def main():
83
  }
84
 
85
  sens_input = st.sidebar.radio(label = 'Select the Sensitivity Level [OPTIONAL]',
86
- help = 'Increasing the level of sensitivity results in more \
87
- applications being filtered out. At the same time, this also \
88
- increases the probability of false negatives (FNs). The rate of \
89
  FNs at the lowest setting is approximately 6 percent, and \
90
  approaches 13 percent at the highest setting. \
91
- NOTE: changing this setting does not affect the raw data in the CSV output file (only the REVIEW/REJECT labels)',
92
  options = list(sens_options.keys()),
93
  index = list(sens_options.keys()).index("High"),
94
  horizontal = False)
@@ -100,7 +100,7 @@ def main():
100
  """
101
  This tool provides an interface for running an automated preliminary assessment of applications to the MAF call for applications.
102
 
103
- The tool functions by running selected text fields from the application through a series of 8 LLMs fine-tuned for text classification (ref. diagram below).
104
  The resulting output classifications are used to compute a score and a suggested pre-filtering action. The tool has been tested against
105
  human assessors and exhibits an extremely low false negative rate (<6%) at a Sensitivity Level of 'Low' (i.e. rejection threshold for predicted score < 4).
106
 
 
83
  }
84
 
85
  sens_input = st.sidebar.radio(label = 'Select the Sensitivity Level [OPTIONAL]',
86
+ help = 'Decreasing the level of sensitivity results in less \
87
+ applications filtered out. This also \
88
+ reduces the probability of false negatives (FNs). The rate of \
89
  FNs at the lowest setting is approximately 6 percent, and \
90
  approaches 13 percent at the highest setting. \
91
+ NOTE: changing this setting does not affect the raw data in the CSV output file (only the labels)',
92
  options = list(sens_options.keys()),
93
  index = list(sens_options.keys()).index("High"),
94
  horizontal = False)
 
100
  """
101
  This tool provides an interface for running an automated preliminary assessment of applications to the MAF call for applications.
102
 
103
+ The tool functions by running selected text fields from the application through a series of LLMs fine-tuned for text classification (ref. diagram below).
104
  The resulting output classifications are used to compute a score and a suggested pre-filtering action. The tool has been tested against
105
  human assessors and exhibits an extremely low false negative rate (<6%) at a Sensitivity Level of 'Low' (i.e. rejection threshold for predicted score < 4).
106
 
images/pipeline.png CHANGED