| Title |
Heterogeneity of Inter-Rater Reliabilities of Grant Peer Reviews and Its Determinants: A General Estimating Equations Approach
|
|---|---|
| Published in |
PLOS ONE, October 2012
|
| DOI | 10.1371/journal.pone.0048509 |
| Pubmed ID | |
| Authors |
Rüdiger Mutz, Lutz Bornmann, Hans-Dieter Daniel |
| Abstract |
One of the most important weaknesses of the peer review process is that different reviewers' ratings of the same grant proposal typically differ. Studies on the inter-rater reliability of peer reviews mostly report only average values across all submitted proposals. But inter-rater reliabilities can vary depending on the scientific discipline or the requested grant sum, for instance. |
X Demographics
The data shown below were collected from the profiles of 36 X users who shared this research output. Click here to find out more about how the information was compiled.
Geographical breakdown
| Country | Count | As % |
|---|---|---|
| United Kingdom | 7 | 19% |
| United States | 3 | 8% |
| Spain | 2 | 6% |
| Italy | 2 | 6% |
| Canada | 2 | 6% |
| Germany | 1 | 3% |
| Belgium | 1 | 3% |
| Peru | 1 | 3% |
| France | 1 | 3% |
| Other | 3 | 8% |
| Unknown | 13 | 36% |
Demographic breakdown
| Type | Count | As % |
|---|---|---|
| Members of the public | 22 | 61% |
| Scientists | 11 | 31% |
| Practitioners (doctors, other healthcare professionals) | 2 | 6% |
| Science communicators (journalists, bloggers, editors) | 1 | 3% |
Mendeley readers
The data shown below were compiled from readership statistics for 36 Mendeley readers of this research output. Click here to see the associated Mendeley record.
Geographical breakdown
| Country | Count | As % |
|---|---|---|
| Chile | 1 | 3% |
| United States | 1 | 3% |
| France | 1 | 3% |
| Belgium | 1 | 3% |
| Unknown | 32 | 89% |
Demographic breakdown
| Readers by professional status | Count | As % |
|---|---|---|
| Researcher | 6 | 17% |
| Other | 4 | 11% |
| Professor | 4 | 11% |
| Professor > Associate Professor | 4 | 11% |
| Student > Ph. D. Student | 4 | 11% |
| Other | 8 | 22% |
| Unknown | 6 | 17% |
| Readers by discipline | Count | As % |
|---|---|---|
| Social Sciences | 6 | 17% |
| Arts and Humanities | 3 | 8% |
| Psychology | 3 | 8% |
| Business, Management and Accounting | 3 | 8% |
| Computer Science | 3 | 8% |
| Other | 6 | 17% |
| Unknown | 12 | 33% |