File size: 2,001 Bytes
ef85f09
3db0544
 
 
 
 
ef85f09
3db0544
ef85f09
 
 
 
3db0544
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
---
title: ccc
tags:
- evaluate
- metric
description: "Concordance correlation coefficient"
sdk: gradio
sdk_version: 3.19.1
app_file: app.py
pinned: false
---

# Metric Card for CCC

## Metric Description
The concordance correlation coefficient measures the agreement between two sets of
values. It is often used as a measure of inter-rater agreement when ratings have
continuous values.

## How to Use
The inputs are two sequences of floating point values. For example:
```python
ccc_metric = evaluate.load("agkphysics/ccc")
results = ccc_metric.compute(references=[0.2, 0.1], predictions=[0.1, 0.2])
```

### Inputs
- **predictions** (list of float): model predictions
- **references** (list of float): reference labels

### Output Values
- `ccc`: the concordance correlation coefficient. This is a value between -1 (perfect
anti-agreement) and 1 (perfect agreement), with 0 indicating no agreement.

### Examples
```python
>>> ccc_metric = evaluate.load("agkphysics/ccc")
>>> results = ccc_metric.compute(references=[0.2, 0.1], predictions=[0.1, 0.2])
>>> print(results)
{'ccc': -1.0}
>>> results = ccc_metric.compute(references=[0.1, 0.2], predictions=[0.1, 0.2])
>>> print(results)
{'ccc': 1.0}
>>> results = ccc_metric.compute(references=[0.1, 0.3], predictions=[0.1, 0.2])
>>> print(results)
{'ccc': 0.666666641831399}
```

## Limitations and Bias
*Note any known limitations or biases that the metric has, with links and references if possible.*

## Citation
```bibtex
@article{linConcordanceCorrelationCoefficient1989,
  title = {A {{Concordance Correlation Coefficient}} to {{Evaluate Reproducibility}}},
  author = {Lin, Lawrence I-Kuei},
  year = {1989},
  journal = {Biometrics},
  volume = {45},
  number = {1},
  pages = {255--268},
  publisher = {{International Biometric Society}},
  issn = {0006-341X},
  url = {https://www.jstor.org/stable/2532051},
  doi = {10.2307/2532051}
}
```

## Further References
Wikipedia: https://en.wikipedia.org/wiki/Concordance_correlation_coefficient