Designing a rating system based on competencies for the analysis of the university teachers' research activities
Keywords:publication activity, scientist profile, scientometric databases, rating system, research activity, research competence, digital competence
One of the indicators of the influence and competitiveness of university is participation in international and local rankings. In the methodologies of the most authoritative rankings, the quality and transparency of Universities is assessed by indicators of the university teachers’ publishing activity. The article analyzes the experience of designing systems that analyses university teachers research activities, tools and components of evaluating the effectiveness of research, designed a structural and functional model of rating system for the analysis the university teachers’ research activities taking into account research and digital competencies. The developed model provides performance of the basic functions and allows for systematic monitoring of openness, transparency, efficiency of the research component of university teachers' professional activity. The model was based on key indicators for evaluating the effectiveness of research -- citation indicators of the three most important scientometric databases -- Scopus, Web of Science, Google Scholar. The connection between the indicators presented in the model forms a portrait of the university teachers’ scientific activity, gives an overall assessment of productivity, influence and contribution to the research direction of the university as a whole. The article describes 1 stage of implementation of the presented model by developing a “Rating of Transparency of Structural Units”, the effectiveness of experimental ranking. The study has established the positive impact of the implementation of the rating system, identified the main activities to increase the visibility, presence, dissemination of research results, the systematic implementation of which contributes to the optimal representation of the scientist in the rating evaluation of the research component of the university teachers professional activities, improving the digital competence of teachers and positively affects the quality indicators of the university scientific work in local and international rankings, as the existence of the system and the formation of ratings is an incentive for university teachers to present and disseminate their own publishing activities in the international online scientific community.
Bibliometrics of Ukrainian science, 2022. Available from: http://nbuviap.gov.ua/bpnu/.
Buinytska, O., Hrytseliak, B. and Smirnova, V., 2018. Rating as assessment tool of quality and competitiveness of university. Open educational e-environment of modern university, 4, pp.16–32. Available from: https://doi.org/10.28925/2414-0325.2018.1632. DOI: https://doi.org/10.28925/2414-0325.2018.1632
Bykov, V. and Spirin, O., 2016. Information and analytical support of scientific and pedagogical research based on electronic bibliometric systems. Reporting scientific-practical conference of the institute of information technologies and learning tools of the national academy of pedagogical sciences of ukraine. pp.1–3. Available from: https://lib.iitta.gov.ua/106914/.
Bykov, V., Spirin, O., Biloshchytskyi, A., Kuchansky, O., Dikhtiarenko, O. and Novytskyi, O., 2020. Open digital systems for assessment of pedagogical research results. Information technologies and learning tools, 75(1), p.294–315. Available from: https://doi.org/10.33407/itlt.v75i1.3589. DOI: https://doi.org/10.33407/itlt.v75i1.3589
Corporate Standard of Digital Competence of Teachers of Borys Grinchenko Kyiv University, 2021. Available from: https://kubg.edu.ua/images/stories/Departaments/vdd/nakaz__421_11.06.21.pdf.
Corporate Standard of Research Activity of the staff of Borys Grinchenko Kyiv University, 2018. Available from: https://kubg.edu.ua/images/stories/Departaments/vdd/documenty/rozdil_8/nakaz_212_02.04.2018.pdf.
Delgado López-Cózar, E., Orduña-Malea, E. and Martín-Martín, A., 2019. Google scholar as a data source for research assessment. In: W. Glänzel, H.F. Moed, U. Schmoch and M. Thelwall, eds. Springer handbook of science and technology indicators. Cham: Springer International Publishing, pp.95–127. Available from: https://doi.org/10.1007/978-3-030-02511-3_4. DOI: https://doi.org/10.1007/978-3-030-02511-3_4
Dzoba, O.H., 2019. Rating assessment of scientific and pedagogical workers: theoretical and methodical aspects within a market approach. Scientific bulletin of ivano-frankivsk national technical university of oil and gas (series: Economics and management in the oil and gas industry), 1(19), p.84–95. Available from: https://doi.org/10.31471/2409-0948-2019-1(19)-84-95. DOI: https://doi.org/10.31471/2409-0948-2019-1(19)-84-95
Gasparyan, A.Y., Yessirkepov, M., Duisenova, A., Trukhachev, V.I., Kostyukova, E.I. and Kitas, G.D., 2018. Researcher and author impact metrics: Variety, value, and context. Journal of korean medical science, 33, p.e139. Available from: https://doi.org/10.3346/jkms.2018.33.e139. DOI: https://doi.org/10.3346/jkms.2018.33.e139
Hohunskyi, V.D., Yakovenko, V.O., Liashchenko, T.O. and Otradska, T.V., 2016. General mechanisms of citation system of scientific articles. Bulletin of ntu "khpi, 1173, p.14–18. Available from: http://dspace.opu.ua/jspui/handle/123456789/1774. DOI: https://doi.org/10.20998/2413-3000.2016.1173.3
Kostenko, L., Symonenko, T. and Zhabin, O., 2019. Project "Bibliometrics of Ukrainian science": idea, realization, plans. Bulletin of the book chamber, 5, pp.30–33.
Luparenko, L., 2020. The use of electronic open journal systems in scientific and pedagogic research: Results of experiment. Ceur workshop proceedings, 2732, pp.1113–1128. Available from: http://ceur-ws.org/Vol-2732/20201113.pdf. DOI: https://doi.org/10.31812/123456789/4465
Martín-Martín, A., Orduna-Malea, E. and Delgado López-Cózar, E., 2018. Coverage of highly-cited documents in Google Scholar, Web of Science, and Scopus: a multidisciplinary comparison. Scientometrics, 116(3), pp.2175–2188. Available from: https://doi.org/10.1007/s11192-018-2820-9. DOI: https://doi.org/10.1007/s11192-018-2820-9
Martín-Martín, A., Orduna-Malea, E., Thelwall, M. and Delgado López-Cózar, E., 2018. Google scholar, web of science, and scopus: A systematic comparison of citations in 252 subject categories. Journal of informetrics, 12(4), pp.1160–1177. Available from: https://doi.org/10.1016/j.joi.2018.09.002. DOI: https://doi.org/10.1016/j.joi.2018.09.002
Morze, N. and Buinytska, O., 2017. Rating indicators system of evaluation teacher’s activities in modern universities. Scientific journal of national pedagogical dragomanov university, 26(19), pp.34–44. Available from: http://enpuir.npu.edu.ua/handle/123456789/19082.
Nazarovets, S., 2019. Open Ukrainian Citation Index (OUCI) project: idea, working principle and development prospects. Intellectual property in ukraine, 3, pp.10–13. Available from: http://eprints.rclis.org/34365/.
Open Ukrainian Citation Index, 2022. Available from: https://ouci.dntb.gov.ua/.
Rating of departments of Kherson State University, 2021. Available from: http://publication.kspu.edu/rating/departments/.
Reheilo, I., 2020. Theoretical bases of estimation and development of scientific and pedagogical workers of universities in the context of realization of scientific activity. In: Y. Skyba, ed. Theoretical bases of development of scientific and pedagogical potential of universities of ukraine in the context of expansion of institutional autonomy: preprint (analytical materials) (part i). Kyiv: IVO NAPS of Ukraine, pp.72–103. Available from: https://doi.org/10.31874/978-617-7486-40-3-2020.
Semerikov, S.O., Pototskyi, V.S., Slovak, K.I., Hryshchenko, S.M. and Kiv, A.E., 2018. Automation of the export data from Open Journal Systems to the Russian Science Citation Index. Ceur workshop proceedings, 2257, pp.215–226. Available from: http://ceur-ws.org/Vol-2257/paper21.pdf. DOI: https://doi.org/10.31812/123456789/2651
Shynenko, M.A., Kilchenko, A.V. and Tukalo, S.M., 2021. Application of scientific metric indicators to evaluate the performance of scientific and pedagogical research. Reporting scientific-practical conference of the institute of information technologies and learning tools of the national academy of pedagogical sciences of ukraine. Kyiv, Ukraine, pp.89–93.
Smirnova, V., 2020. Research on open digital information systems for analysis of research activity results of higher education institutions academic staff. Open educational e-environment of modern university, 9, pp.134–144. Available from: https://doi.org/10.28925/2414-0325.2020.9.11. DOI: https://doi.org/10.28925/2414-0325.2020.9.11
Spivakovsky, A., Vinnyk, M., Poltoratskiy, M., Tarasich, Y., Spivakovska, Y., Gardner, G. and Panova, K., 2019. Information system of scientific activity indicators of scientific organizations: Development status and prospects. Ceur workshop proceedings, 2393, pp.220–228. Available from: http://ceur-ws.org/Vol-2393/paper_260.pdf.
Vakarenko, O., 2018. Scientometric databases: from system of obtaining information to instrument for evaluating scientific research. Science of ukraine in the world information space, 15, pp.9–15. Available from: https://doi.org/10.15407/akademperiodyka.372.009. DOI: https://doi.org/10.15407/akademperiodyka.372.009
Yaroshenko, O., 2020. Theoretical bases of rating as a tool for evaluating the activities of scientific and pedagogical staff of ukrainian universities. In: Y. Skyba, ed. Theoretical bases of development of scientific and pedagogical potential of universities of ukraine in the context of expansion of institutional autonomy: preprint (analytical materials) (part i). Kyiv: IVO NAPS of Ukraine, pp.57—-71. Available from: https://doi.org/10.31874/978-617-7486-40-3-2020. DOI: https://doi.org/10.31874/978-617-7486-40-3-2020
How to Cite
This work is licensed under a Creative Commons Attribution 4.0 International License.