Two circuit assessments of the performance of scientific organizations in Russia: current state and development prospects from the point of view of international experience

Abstract

In Russia, in fact, two contours for assessing the scientific performance of organizations have developed: the expert one, which underlies the categorization of scientific organizations, and the quantitative one, which, according to the methodology of the comprehensive calculation of publication productivity, makes it possible to determine and monitor the implementation of the state assignment for fundamental scientific research. The article describes the history of the formation of these circuits, their advantages and disadvantages, as well as the prerequisites for further development. The British REF (Research Excellence Framework) examination system and the Norwegian quantitative assessment model are considered as model examples for improving both circuits. REF features include a differentiated assessment of the results, impact and environment of scientific units, which is organized by expert panels and groups. The features of the Norwegian model are an expert approach to the formation of a national white list of scientific journals, conferences and publishers, a methodology for calculating the publication indicator and an open database of publications of Norwegian scientists, from which this indicator is determined. The authors believe that these two examples can be considered as parametric assessment models, the adaptation of which taking into account national characteristics will make it possible to update and improve both contours of the assessment of scientific organizations in Russia. The importance of regular retrospective reflection on the experience, procedures and results of assessing organizations is emphasized, which is necessary for the systematic development of this system at the next stages.