Journal article
A ‘perverse incentive’ from bibliometrics: could National Research Assessment Exercises (NRAEs) restrict literature availability for nature conservation?
Scientometrics, Vol.95(1), pp.243-255
2013
Abstract
National Research Assessment Exercises (NRAEs) aim to improve returns from public funding of research. Critics argue that they undervalue publications influencing practice, not citations, implying that journals valued least by NRAEs are disproportionately useful to practitioners. Conservation biology can evaluate this criticism because it uses species recovery plans, which are practitioner-authored blueprints for recovering threatened species. The literature cited in them indicates what is important to practitioners' work. We profiled journals cited in 50 randomly selected recovery plans from each of the USA, Australia and New Zealand, using ranking criteria from the Australian Research Council and the SCImago Institute. Citations showed no consistent pattern. Sometimes higher ranked publications were represented more frequently, sometimes lower ranked publications. Recovery plans in all countries also contained 37 % or more citations to 'grey literature', discounted in NRAEs. If NRAEs discourage peer-reviewed publication at any level they could exacerbate the trend not to publish information useful for applied conservation, possibly harming conservation efforts. While indicating the potential for an impact does not establish that it occurs, it does suggest preventive steps. NRAEs considering the proportion of papers in top journals may discourage publication in lower-ranked journals, because one way to increase the proportion of outputs in top journals is by not publishing in lower ones. Instead, perhaps only a user-nominated subset of publications could be evaluated, a department's or an individual's share of the top publications in a field could be noted, or innovative new multivariate assessments of research productivity applied, including social impact.
Details
- Title
- A ‘perverse incentive’ from bibliometrics: could National Research Assessment Exercises (NRAEs) restrict literature availability for nature conservation?
- Authors/Creators
- M.C. Calver (Author/Creator) - Murdoch UniversityM. Lilith (Author/Creator) - Murdoch UniversityC.R. Dickman (Author/Creator) - The University of Sydney
- Publication Details
- Scientometrics, Vol.95(1), pp.243-255
- Publisher
- Springer Verlag
- Identifiers
- 991005542943107891
- Copyright
- © Akadémiai Kiadó, Budapest, Hungary 2012
- Murdoch Affiliation
- School of Veterinary and Life Sciences
- Language
- English
- Resource Type
- Journal article
Metrics
334 File views/ downloads
80 Record Views
InCites Highlights
These are selected metrics from InCites Benchmarking & Analytics tool, related to this output
- Collaboration types
- Domestic collaboration
- Citation topics
- 6 Social Sciences
- 6.238 Bibliometrics, Scientometrics & Research Integrity
- 6.238.166 Bibliometrics
- Web Of Science research areas
- Computer Science, Interdisciplinary Applications
- Information Science & Library Science
- ESI research areas
- Social Sciences, general