| Title |
A Reliability-Generalization Study of Journal Peer Reviews: A Multilevel Meta-Analysis of Inter-Rater Reliability and Its Determinants
|
|---|---|
| Published in |
PLOS ONE, December 2010
|
| DOI | 10.1371/journal.pone.0014331 |
| Pubmed ID | |
| Authors |
Lutz Bornmann, Rüdiger Mutz, Hans-Dieter Daniel |
| Abstract |
This paper presents the first meta-analysis for the inter-rater reliability (IRR) of journal peer reviews. IRR is defined as the extent to which two or more independent reviews of the same scientific document agree. |
X Demographics
The data shown below were collected from the profiles of 46 X users who shared this research output. Click here to find out more about how the information was compiled.
Geographical breakdown
| Country | Count | As % |
|---|---|---|
| United States | 9 | 20% |
| United Kingdom | 5 | 11% |
| Netherlands | 2 | 4% |
| Hungary | 1 | 2% |
| Spain | 1 | 2% |
| France | 1 | 2% |
| Canada | 1 | 2% |
| Czechia | 1 | 2% |
| Mauritius | 1 | 2% |
| Other | 3 | 7% |
| Unknown | 21 | 46% |
Demographic breakdown
| Type | Count | As % |
|---|---|---|
| Members of the public | 22 | 48% |
| Scientists | 19 | 41% |
| Science communicators (journalists, bloggers, editors) | 3 | 7% |
| Practitioners (doctors, other healthcare professionals) | 2 | 4% |
Mendeley readers
The data shown below were compiled from readership statistics for 168 Mendeley readers of this research output. Click here to see the associated Mendeley record.
Geographical breakdown
| Country | Count | As % |
|---|---|---|
| United States | 9 | 5% |
| Germany | 4 | 2% |
| Spain | 3 | 2% |
| Switzerland | 2 | 1% |
| Netherlands | 2 | 1% |
| United Kingdom | 2 | 1% |
| Chile | 1 | <1% |
| Australia | 1 | <1% |
| Italy | 1 | <1% |
| Other | 5 | 3% |
| Unknown | 138 | 82% |
Demographic breakdown
| Readers by professional status | Count | As % |
|---|---|---|
| Researcher | 42 | 25% |
| Student > Ph. D. Student | 25 | 15% |
| Student > Master | 22 | 13% |
| Professor | 15 | 9% |
| Other | 13 | 8% |
| Other | 34 | 20% |
| Unknown | 17 | 10% |
| Readers by discipline | Count | As % |
|---|---|---|
| Psychology | 37 | 22% |
| Social Sciences | 26 | 15% |
| Medicine and Dentistry | 15 | 9% |
| Agricultural and Biological Sciences | 14 | 8% |
| Computer Science | 12 | 7% |
| Other | 37 | 22% |
| Unknown | 27 | 16% |