text: 433,214,1277496891371028481,293983295,Vincent Traag,"In this preprint we study the agreement between metrics and peer review at the institutional level and also quantify the internal agreement of peer review. Our analysis is based on a sample of the Italian VQR exercise organised by @anvur_ita <LINK> The agreement between metrics and peer review is on par with the internal agreement among two reviewers for certain fields of science. (Figure shows median absolute differences on a scale 3-30) <LINK> The level of agreement is generally lower at the publication level level than at the institutional level, for both metrics and peer review. <LINK> This work follows up on earlier work on the UK REF <LINK> All data for replication is available from <LINK>",https://arxiv.org/abs/2006.14830,"In the past decades, many countries have started to fund academic institutions based on the evaluation of their scientific performance. In this context, peer review is often used to assess scientific performance. Bibliometric indicators have been suggested as an alternative. A recurrent question in this context is whether peer review and metrics tend to yield similar outcomes. In this paper, we study the agreement between bibliometric indicators and peer review at the institutional level. Additionally, we also quantify the internal agreement of peer review at the institutional level. We find that the level of agreement is generally higher at the institutional level than at the publication level. Overall, the agreement between metrics and peer review is on par with the internal agreement among two reviewers for certain fields of science. This suggests that for some fields, bibliometric indicators may possibly be considered as an alternative to peer review for national research assessment exercises. ",Metrics and peer review agreement at the institutional level,5,"['In this preprint we study the agreement between metrics and peer review at the institutional level and also quantify the internal agreement of peer review. Our analysis is based on a sample of the Italian VQR exercise organised by @anvur_ita <LINK>', 'The agreement between metrics and peer review is on par with the internal agreement among two reviewers for certain fields of science. (Figure shows median absolute differences on a scale 3-30) https://t.co/xOM5Orfgjh', 'The level of agreement is generally lower at the publication level level than at the institutional level, for both metrics and peer review. https://t.co/BU5WfiXH9J', 'This work follows up on earlier work on the UK REF https://t.co/DR6e4o3nP4', 'All data for replication is available from\nhttps://t.co/8fj8WxPc3s']",20,06,704