Abstract
Recent research in the field of reflexive metrics, which analyses the effects of the use of performance indicators on scientific conduct, has studied the emergence and consequences of evaluation gaps in science. The concept of evaluation gaps captures potential discrepancies between what researchers value about their research, in particular research quality, and what metrics measure. In the language of rational choice theory, an evaluation gap persists if motivational factors arising out of the internal component of an actor’s situation are incongruent with those arising out of the external components. The aim of this research is therefore to study and compare autonomous and controlled motivations to become an astronomer, to do research in astronomy and to publish scientific papers. This study is based on a comprehensive quantitative survey of academic and non-academic astronomers worldwide with 3509 responses. By employing verified instruments to measure perceived publication pressure, distributive & procedural justice, overcommitment to work and observation of scientific misconduct, this paper also investigates how these different motivational factors affect research output and behaviour. I find evidence for an evaluation gap and that controlled motivational factors arising from evaluation procedures based on publication record drives up publication pressure, which, in turn, was found to increase the likelihood of perceived frequency of misbehaviour.
Funder
Bundesministerium für Bildung, Wissenschaft und Forschung
Publisher
Public Library of Science (PLoS)
Reference24 articles.
1. Implicated in the Indicator Game? An Experimental Debate;M. Fochler;Engag. Sci. Technol. Soc,2017
2. Heuritsch, J. Effects of metrics in research evaluation on knowledge production in astronomy A case study on Evaluation Gap and Constitutive Effects. In Proceedings of the STS Conference Graz 2019, Graz, Austria, 6–7 May 2019.
3. Haven, T.L. Towards a Responsible Research Climate: Findings from Academic Research in Amsterdam. 2021. https://research.vu.nl/en/publications/towards-a-responsible-research-climate-findings-from-academic-res (accessed on 26th November 2021).
4. The Perverse Effects of Competition on Scientists’ Work and Relationships;M.S. Anderson;Sci. Eng. Ethics,2007
5. The Academic Manifesto: From an Occupied to a Public University;W. Halffman;Minerva,2015