Update GreaterThan_Detector_NN_ReadMe.md
Browse files
GreaterThan_Detector_NN_ReadMe.md
CHANGED
@@ -1,16 +1,19 @@
|
|
1 |
# GreaterThan_Detector_NN: A Challenge in Numerical Reasoning
|
2 |
|
3 |
-
Here is a GreaterThan_Detector_NN_ReadMe.md
|
4 |
-
It reports the results, presents the core challenge, and provides the dataset generator
|
|
|
5 |
|
6 |
GreaterThan_Detector_NN: A Challenge in Numerical Reasoning
|
7 |
|
8 |
-
This repository, part of the Neural_Nets_Doing_Simple_Tasks collection, explores a fundamental question:
|
|
|
9 |
The specific task is to compare two numbers presented in a natural language format and identify the greater or lesser one.
|
10 |
|
11 |
The Objective
|
12 |
|
13 |
-
The goal is to create a model that can reliably process a text-based prompt, parse two numbers, understand the question
|
|
|
14 |
|
15 |
The input-output format is a single, continuous text sequence. For example:
|
16 |
|
@@ -21,7 +24,6 @@ Generated code
|
|
21 |
|
22 |
Expected Completion:
|
23 |
|
24 |
-
Generated code
|
25 |
10.00!
|
26 |
|
27 |
This makes the full, correct sequence:
|
@@ -29,9 +31,11 @@ This makes the full, correct sequence:
|
|
29 |
|
30 |
The Dataset
|
31 |
|
32 |
-
The training data is synthetically generated. This ensures an endless supply of examples but also presents a challenge:
|
|
|
33 |
|
34 |
-
You can generate your own dataset using the Python function below. This is the exact generator used for our baseline model,
|
|
|
35 |
|
36 |
Dataset Generator Code
|
37 |
|
@@ -99,7 +103,8 @@ Prompt Model's Completion Result
|
|
99 |
|
100 |
Analysis & The Challenge
|
101 |
|
102 |
-
The baseline model demonstrates a classic problem in machine learning: it has learned to be a good pattern matcher
|
|
|
103 |
|
104 |
The failures are illuminating:
|
105 |
|
|
|
1 |
# GreaterThan_Detector_NN: A Challenge in Numerical Reasoning
|
2 |
|
3 |
+
Here is a GreaterThan_Detector_NN_ReadMe.md challenge defintion file.
|
4 |
+
It reports the results, presents the core challenge, and provides the dataset generator,
|
5 |
+
inviting the community to tackle the same problem.
|
6 |
|
7 |
GreaterThan_Detector_NN: A Challenge in Numerical Reasoning
|
8 |
|
9 |
+
This repository, part of the Neural_Nets_Doing_Simple_Tasks collection, explores a fundamental question:
|
10 |
+
can a general-purpose neural network learn a task that is trivial for humans but requires symbolic reasoning?
|
11 |
The specific task is to compare two numbers presented in a natural language format and identify the greater or lesser one.
|
12 |
|
13 |
The Objective
|
14 |
|
15 |
+
The goal is to create a model that can reliably process a text-based prompt, parse two numbers, understand the question
|
16 |
+
("Which is Greater?" or "Which is Lesser?"), and generate the correct numerical answer.
|
17 |
|
18 |
The input-output format is a single, continuous text sequence. For example:
|
19 |
|
|
|
24 |
|
25 |
Expected Completion:
|
26 |
|
|
|
27 |
10.00!
|
28 |
|
29 |
This makes the full, correct sequence:
|
|
|
31 |
|
32 |
The Dataset
|
33 |
|
34 |
+
The training data is synthetically generated. This ensures an endless supply of examples but also presents a challenge:
|
35 |
+
is the generated data diverse enough to teach true reasoning, or does it just encourage brittle pattern matching?
|
36 |
|
37 |
+
You can generate your own dataset using the Python function below. This is the exact generator used for our baseline model,
|
38 |
+
ensuring a level playing field.
|
39 |
|
40 |
Dataset Generator Code
|
41 |
|
|
|
103 |
|
104 |
Analysis & The Challenge
|
105 |
|
106 |
+
The baseline model demonstrates a classic problem in machine learning: it has learned to be a good pattern matcher
|
107 |
+
but has not acquired a robust, generalizable algorithm for numerical comparison.
|
108 |
|
109 |
The failures are illuminating:
|
110 |
|