Spaces:
Runtime error
Runtime error
File size: 2,001 Bytes
ef85f09 3db0544 ef85f09 3db0544 ef85f09 3db0544 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 |
---
title: ccc
tags:
- evaluate
- metric
description: "Concordance correlation coefficient"
sdk: gradio
sdk_version: 3.19.1
app_file: app.py
pinned: false
---
# Metric Card for CCC
## Metric Description
The concordance correlation coefficient measures the agreement between two sets of
values. It is often used as a measure of inter-rater agreement when ratings have
continuous values.
## How to Use
The inputs are two sequences of floating point values. For example:
```python
ccc_metric = evaluate.load("agkphysics/ccc")
results = ccc_metric.compute(references=[0.2, 0.1], predictions=[0.1, 0.2])
```
### Inputs
- **predictions** (list of float): model predictions
- **references** (list of float): reference labels
### Output Values
- `ccc`: the concordance correlation coefficient. This is a value between -1 (perfect
anti-agreement) and 1 (perfect agreement), with 0 indicating no agreement.
### Examples
```python
>>> ccc_metric = evaluate.load("agkphysics/ccc")
>>> results = ccc_metric.compute(references=[0.2, 0.1], predictions=[0.1, 0.2])
>>> print(results)
{'ccc': -1.0}
>>> results = ccc_metric.compute(references=[0.1, 0.2], predictions=[0.1, 0.2])
>>> print(results)
{'ccc': 1.0}
>>> results = ccc_metric.compute(references=[0.1, 0.3], predictions=[0.1, 0.2])
>>> print(results)
{'ccc': 0.666666641831399}
```
## Limitations and Bias
*Note any known limitations or biases that the metric has, with links and references if possible.*
## Citation
```bibtex
@article{linConcordanceCorrelationCoefficient1989,
title = {A {{Concordance Correlation Coefficient}} to {{Evaluate Reproducibility}}},
author = {Lin, Lawrence I-Kuei},
year = {1989},
journal = {Biometrics},
volume = {45},
number = {1},
pages = {255--268},
publisher = {{International Biometric Society}},
issn = {0006-341X},
url = {https://www.jstor.org/stable/2532051},
doi = {10.2307/2532051}
}
```
## Further References
Wikipedia: https://en.wikipedia.org/wiki/Concordance_correlation_coefficient
|