Update readme
Browse files
README.md
CHANGED
@@ -22,12 +22,12 @@ Try out our [interactive demo](https://huggingface.co/spaces/cdlib/marc-match-ai
|
|
22 |
- Adjustable Matching Threshold: Allows tuning the balance between false positives and false negatives based on specific use cases.
|
23 |
|
24 |
## Performance
|
25 |
-
This model achieves 98.46% accuracy on our validation set (see our [
|
|
|
|
|
26 |
|
27 |
| Algorithm | % False Positives | % False Negatives |
|
28 |
|-----------------|-------------------|-------------------|
|
29 |
| Goldrush | 0.30% | 4.79% |
|
30 |
| SCSB | 0.52% | 0.40% |
|
31 |
| __Our Model__ | __0.23%__ | __1.95%__ |
|
32 |
-
| OCLC | 0.05% | 2.73% |
|
33 |
-
| OCLC Reconciled | 0.10% | 1.23% |
|
|
|
22 |
- Adjustable Matching Threshold: Allows tuning the balance between false positives and false negatives based on specific use cases.
|
23 |
|
24 |
## Performance
|
25 |
+
This model achieves 98.46% accuracy on our validation set (see our [GitHub repository](https://github.com/cdlib/marc-ai) for datasets).
|
26 |
+
|
27 |
+
It has also had comparable accuracy with SCSB, and Goldrush on a separate set of English monographs. Each matching algorithm was run on a common set to produce a union set of all of the algorithms' matches. Using a matching threshold of 0.99 to minimize false positives, we were able to compare the algorithms' matches. Disagreements between the algorithms were manually reviewed, resulting in false positives and false negatives for those disagreements:
|
28 |
|
29 |
| Algorithm | % False Positives | % False Negatives |
|
30 |
|-----------------|-------------------|-------------------|
|
31 |
| Goldrush | 0.30% | 4.79% |
|
32 |
| SCSB | 0.52% | 0.40% |
|
33 |
| __Our Model__ | __0.23%__ | __1.95%__ |
|
|
|
|