Ukraine higher education based on data-driven decision making (DDDM)

Authors

DOI:

https://doi.org/10.55056/cte.564

Keywords:

course assessment, self-assessment of competencies, higher education, data-driven decision-making, online learning, quality of education, quality of online learning, ethic of testing, quality of teachers’ activity

Abstract

This article presents a theoretical review and empirical study of the assessment of the quality of BA and MA online education during the Russian military invasion of Ukraine in 2022. A qualitative theoretical analysis and comparison are made with a study of higher education quality assessment across Ukraine during the war in 2022 (\textit{N} = 12019). The article analyzes the tools and structure of student feedback on the evaluation of the educational process. The undergraduate and graduate programs are modified based on the analysis of this data. In the Ukrainian higher education space, the National Qualifications Framework requirements for each specialty have been under development since 2014. The National Qualifications Framework developed a list of interdisciplinary competencies that should be transferred to academic courses. According to the Ukrainian higher education standard, universities must provide empirical evidence that their students actually acquire these competencies. Baseline data on the assessment of the quality of online education by student teachers during the war in Ukraine is presented using the case study of the Kriviy Rih State Pedagogical University (\textit{N} = 688). Further modifications of the questionnaire to assess the quality of teaching in order to improve data-driven decision-making and testing ethics are proposed.

Downloads

Download data is not yet available.
Abstract views: 420 / PDF views: 211

References

Alekseyev, A.N., Konovalova, N.A., Lozova, C.A. and Trofimrnko, P.E., 2015. Importance and complexity of test tasks at evaluation of activity of university professors. Bulletin of the Kyiv National University of Technologies and Design. Technical Science Series, 2(84), pp.240–246. Available from: https://tinyurl.com/2p8ph7rf.

Ang, K.L.M., Ge, F.L. and Seng, K.P., 2020. Big Educational Data & Analytics: Survey, Architecture and Challenges. IEEE Access, 8, pp.116392–116414. Available from: https://doi.org/10.1109/ACCESS.2020.2994561. DOI: https://doi.org/10.1109/ACCESS.2020.2994561

Beatty, B.J., 2019. Hybrid-Flexible Course Design: Implementing student-directed hybrid classes. Provo, Utah: EdTech Books. Available from: https://edtechbooks.org/hyflex. DOI: https://doi.org/10.59668/33

Beauducel, A. and Wittmann, W.W., 2005. Simulation Study on Fit Indexes in CFA Based on Data With Slightly Distorted Simple Structure. Structural Equation Modeling: A Multidisciplinary Journal, 12(1), pp.41–75. Available from: https://doi.org/10.1207/s15328007sem1201_3. DOI: https://doi.org/10.1207/s15328007sem1201_3

Bloom, B.S., 1994. Reflections on development retrospective. In: L.W. Anderson and L.A. Sosniak, eds. Bloom’s Taxonomy: A Forty-year Retrospective. Chicago, IL: The National Society for the Study of Education, Yearbook of the National Society for the Study of Education, pp.1–8.

Bloom, D.E., Canning, D. and Sevilla, J., 2003. The Demographic Dividend: A New Perspective on the Economic Consequences of Population Change. 1st ed. RAND Corporation. Available from: http://www.jstor.org/stable/10.7249/mr1274wfhf-dlpf-rf-unpf DOI: https://doi.org/10.7249/MR1274

Braun, E., Gusy, B., Leidner, B. and Hannover, B., 2008. Das Berliner Evaluationsinstrument für selbsteingeschätzte, studentische Kompetenzen (BEvaKomp). Diagnostica, 54(1), pp.30–42. Available from: https://doi.org/10.1026/0012-1924.54.1.30. DOI: https://doi.org/10.1026/0012-1924.54.1.30

Braun, E. and Leidner, B., 2009. Academic Course Evaluation: Theoretical and Empirical Distinctions Between Self-Rated Gain in Competences and Satisfaction with Teaching Behavior. European Psychologist, 14(4), pp.297–306. Available from: https://doi.org/10.1027/1016-9040.14.4.297. DOI: https://doi.org/10.1027/1016-9040.14.4.297

Braun, V. and Clarke, V., 2006. Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), pp.77–101. Available from: https://doi.org/10.1191/1478088706qp063oa. DOI: https://doi.org/10.1191/1478088706qp063oa

Cabinet of Ministers of Ukraine, 2022. On approval of the Strategy for the Development of Higher Education in Ukraine for 2022-2032. Available from: https://zakon.rada.gov.ua/laws/show/286-2022.

Chorna, O.V., 2020. Monitoring of quality of higher education in Ukraine and Germany: comparative aspect. Educational Dimension, 2, p.213–225. Available from: https://doi.org/10.31812/educdim.v54i2.3869. DOI: https://doi.org/10.31812/educdim.v54i2.3869

Dochy, F.J.R.C. and Alexander, P.A., 1995. Mapping prior knowledge: A framework for discussion among researchers. European Journal of Psychology of Education, 10(3), pp.225–242. Available from: https://doi.org/10.1007/BF03172918. DOI: https://doi.org/10.1007/BF03172918

Dübbers, F. and Schmidt-Daffy, M., 2021. Self-determined motivation for data-based decision-making: A relevance intervention in teacher training. Cogent Education, 8(1), p.1956033. Available from: https://doi.org/10.1080/2331186X.2021.1956033. DOI: https://doi.org/10.1080/2331186X.2021.1956033

Erpenbeck, J., 2003. Der Programmbereich “Grundlagenforschung”. Zwei Jahre “Lernkultur Kompetenzentwicklung”: Inhalte – Ergebnisse – Perspektiven. Berlin, QUEM-Report, vol. 79, pp.7–89. Available from: https://www.abwf.de/content/main/publik/report/2003/Report-79.pdf.

Govermental portal, 2020. Education and Science Reform. Available from: https://www.kmu.gov.ua/en/reformi/rozvitok-lyudskogo-kapitalu/reforma-osviti.

Irvine, V., Code, J. and Richards, L., 2013. Realigning Higher Education for the 21st-Century Learner through Multi-Access Learning. MERLOT Journal of Online Learning and Teaching, 9(2), pp.172–185. Available from: https://jolt.merlot.org/vol9no2/irvine_0613.pdf.

Ishutina, O.Y., 2014. E-portfolio by means of Google Apps in the monitoring of linhvomethodological competence of students’ philologists. CTE Workshop Proceedings, 2, p.96–99. Available from: https://doi.org/10.55056/cte.193. DOI: https://doi.org/10.55056/cte.193

Kovalchuk, V., Maslich, S. and Movchan, L., 2023. Digitalization of vocational education under crisis conditions. Educational Technology Quarterly. Available from: https://doi.org/10.55056/etq.49. DOI: https://doi.org/10.55056/etq.49

Kunter, M. and Voss, T., 2011. Das Modell der Unterrichtsqualität in COACTIV: Eine multikriteriale Analyse. In: M. Kunter, J. Baumert, W. Blum, U. Klusmann, S. Krauss and M. Neubrand, eds. Professionelle Kompetenz von Lehrkräften – Ergebnisse des Forschungsprogramms COACTIV. Münster: Waxmann, pp.85–113. Available from: https://www.researchgate.net/publication/50809729. DOI: https://doi.org/10.31244/9783830974338

Machova, R., Komarkova, J. and Lnenicka, M., 2016. Processing of big educational data in the cloud using Apache Hadoop. 2016 International Conference on Information Society (i-Society). pp.46–49. Available from: https://doi.org/10.1109/i-Society.2016.7854170. DOI: https://doi.org/10.1109/i-Society.2016.7854170

Marsh, H.W., Hau, K.T. and Wen, Z., 2004. In Search of Golden Rules: Comment on Hypothesis-Testing Approaches to Setting Cutoff Values for Fit Indexes and Dangers in Overgeneralizing Hu and Bentler’s (1999) Findings. Structural Equation Modeling: A Multidisciplinary Journal, 11(3), pp.320–341. Available from: https://doi.org/10.1207/s15328007sem1103_2. DOI: https://doi.org/10.1207/s15328007sem1103_2

Miller, A.N., Sellnow, D.D. and Strawser, M.G., 2021. Pandemic pedagogy challenges and opportunities: instruction communication in remote, HyFlex, and BlendFlex courses. Communication Education, 70(2), pp.202–204. Available from: https://doi.org/10.1080/03634523.2020.1857418. DOI: https://doi.org/10.1080/03634523.2020.1857418

National agency for higher education quality assurance, 2019. Strategy of the National agency for higher education quality assurance to 2022. Available from: https://en.naqa.gov.ua/?page_id=642.

Piskurska, H.V., 2020. The technology of teaching quality online assessment. Dukhovnist osobystosti: metodolohiia, teoriia i praktyka, (1(94)), pp.192–201. Available from: http://nbuv.gov.ua/UJRN/domtp_2020_1_19. DOI: https://doi.org/10.33216/2220-6310-2020-94-1-192-201

Polhun, K., Kramarenko, T., Maloivan, M. and Tomilina, A., 2021. Shift from blended learning to distance one during the lockdown period using Moodle: test control of students’ academic achievement and analysis of its results. Journal of Physics: Conference Series, 1840(1), p.012053. Available from: https://doi.org/10.1088/1742-6596/1840/1/012053. DOI: https://doi.org/10.1088/1742-6596/1840/1/012053

Proiekty tsyfrovoi transformatsii, 2021. Available from: https://plan2.diia.gov.ua/projects.

Protska, S.M., 2015. Components of computer-oriented methods of formation of professional competence of future philologists. CTE Workshop Proceedings, 3, p.251–259. Available from: https://doi.org/10.55056/cte.273. DOI: https://doi.org/10.55056/cte.273

Rosa, M.J., Williams, J., Claeys, J., Kane, D., Bruckmann, S., Costa, D. and Rafael, J.A., 2022. Learning analytics and data ethics in performance data management: a benchlearning exercise involving six European universities. Quality in Higher Education, 28(1), pp.65–81. Available from: https://doi.org/10.1080/13538322.2021.1951455. DOI: https://doi.org/10.1080/13538322.2021.1951455

Saukh, P., Nabok, M., Kizilov, O. and Kuzina, I., 2021. The quality of higher education in ukraine through the eyes of students. Herald of the National Academy of Educational Sciences of Ukraine, 3(2), pp.1–8. Available from: https://doi.org/10.37472/2707-305X-2021-3-2-11-5. DOI: https://doi.org/10.37472/2707-305X-2021-3-2-14-2

School of Political Analysis of NaUKMA, 2022. Survey “Higher education in the conditions of war through the eyes of students”. Available from: https://naqa.gov.ua/2022/09.

Slavin, R.E., 1983. When does cooperative learning increase student achievement? Psychological bulletin, 94(3), p.429. Available from: https://doi.org/10.1037/0033-2909.94.3.429. DOI: https://doi.org/10.1037/0033-2909.94.3.429

Staufenbiel, T. and Hartz, C., 2000. Organizational Citizenship Behavior: Entwicklung und erste Validierung eines Meßinstruments [Organizational Citizenship Behavior: Development and validation of a measurement instrument]. Diagnostica, 46(2), pp.73–83. Available from: https://doi.org/10.1026/0012-1924.46.2.73. DOI: https://doi.org/10.1026//0012-1924.46.2.73

Sultanova, L.Y., Tsiuniak, O.P., Milto, L.O., Zheludenko, M.O., Lyktei, L.M., Petrenko, L.M. and Uchitel, A.D., 2021. The potential of Google Classroom web service for lecturers of higher educational establishments under pandemic conditions. CTE Workshop Proceedings, 8, p.346–365. Available from: https://doi.org/10.55056/cte.279. DOI: https://doi.org/10.55056/cte.279

Thiel, F., Blüthmann, I. and Watermann, R., 2012. Konstruktion eines Fragebogens zur Erfassung der Lehrkompetenz (LeKo). In: B. Berendt, H.P. Voss and J. Wildt, eds. Neues Handbuch Hochschullehre. Lehren und Lernen effizient gestalten. Berlin: Raabe, vol. I. Evaluation. Veranstaltungsevaluation.

Tømte, C.E., Fossland, T., Aamodt, P.O. and Degn, L., 2019. Digitalisation in higher education: mapping institutional approaches for teaching and learning. Quality in Higher Education, 25(1), pp.98–114. Available from: https://doi.org/10.1080/13538322.2019.1603611. DOI: https://doi.org/10.1080/13538322.2019.1603611

Vasyliuk, T.G., 2021. Model of formation of social competence of students in the process of studying the disciplines of the humanitarian cycle. Educational Dimension, 4, p.171–182. Available from: https://doi.org/10.31812/educdim.v56i4.4383. DOI: https://doi.org/10.31812/educdim.v56i4.4383

Wentzel, K.R., 1999. Social-motivational processes and interpersonal relationships: Implications for understanding motivation at school. Journal of Educational Psychology, 91(1), p.76–97. Available from: https://doi.org/10.1037/0022-0663.91.1.76. DOI: https://doi.org/10.1037/0022-0663.91.1.76

Westermann, R., Spies, K., Heise, E. and Wollburg-Claar, S., 1998. Bewertung von Lehrveranstaltungen und Studienbedingungen durch Studierende: Theorieorientierte Entwicklung von Fragebögen. Empirische Pädagogik, 12, pp.133–166.

Downloads

Published

2023-03-21

Issue

Section

Social Analytics in Education

How to Cite

Bondar, K., Shestopalova, O., Hamaniuk, V. and Tursky, V., 2023. Ukraine higher education based on data-driven decision making (DDDM). CTE Workshop Proceedings [Online], 10, pp.346–365. Available from: https://doi.org/10.55056/cte.564 [Accessed 14 June 2024].
Received 2022-10-19
Accepted 2022-12-22
Published 2023-03-21

Similar Articles

1-10 of 394

You may also start an advanced similarity search for this article.