Methods for predicting the assessment of the quality of educational programs and educational activities using a neuro-fuzzy approach
Keywords:evaluation criteria, educational program, educational activities, prognostication, rating, ANFIS, artificial neural networks
In the process of self-assessment and accreditation examination, assessment is carried out according to a scale that covers four levels of compliance with the quality criteria of the educational program and educational activities. Assessing the quality of education is complicated by the fact that the value of quality criteria is due to a large number of factors, possibly with an unknown nature of influence, as well as the fact that when conducting pedagogical measurements it is necessary to work with non-numerical information. To solve these problems, the authors proposed a method for assessing the quality of educational programs and educational activities based on the adaptive neuro-fuzzy input system (ANFIS), implemented in the package Fuzzy Logic Toolbox system MATLAB and artificial neural network direct propagation with one output and multiple inputs. As input variables of the system ANFIS used criteria for evaluating the educational program. The initial variable of the system formed a total indicator of the quality of the curriculum and educational activities according to a certain criterion or group of criteria. The article considers a neural network that can provide a forecast for assessing the quality of educational programs and educational activities by experts. The training of the artificial neural network was carried out based on survey data of students and graduates of higher education institutions. Before the accreditation examination, students were offered questionnaires with a proposal to assess the quality of the educational program and educational activities of the specialty on an assessment scale covering four levels. Student assessments were used to form the vector of artificial neural network inputs. It was assumed that if the assessments of students and graduates are sorted by increasing the rating based on determining the average grade point average, the artificial neural network, which was taught based on this organized data set, can provide effective forecasts of accreditation examinations. As a result of comparing the initial data of the neural network with the estimates of experts, it was found that the neural network does make predictions quite close to reality.
Arsad, P.M., Buniyamin, N. and Manan, J.l.A., 2013. A neural network students’ performance prediction model (nnsppm). 2013 ieee international conference on smart instrumentation, measurement and applications (icsima). pp.1–5. Available from: https://doi.org/10.1109/ICSIMA.2013.6717966. DOI: https://doi.org/10.1109/ICSIMA.2013.6717966
Belyux, K.V. and Sitkar, T.V., 2020. Vykorystannya glybynnyx nejronnyh merezh v naukovyh doslidzhennyah ta osviti [The use of deep neural networks in research and education]. Shlyax u nauku: pershi kroky. pp.379–384. Available from: http://dspace.tnpu.edu.ua/jspui/bitstream/123456789/16319/1/Conf_Shlax_nayky.pdf#page=110.
Black, S.E., Lincove, J., Cullinane, J. and Veron, R., 2015. Can you leave high school behind? Economics of education review, 46, pp.52–63. Available from: https://doi.org/10.1016/j.econedurev.2015.02.003. DOI: https://doi.org/10.1016/j.econedurev.2015.02.003
Bukreyev, D.O. and Serdyuk, I.M., 2019. Metod vykorystannya nejronnoyi merezhi dlya prognozuvannya efektyvnosti roboty studentiv [A method for using a neural network to predict student performance]. Informacijni texnologiyi v osviti ta nauci. vol. 11, pp.61–64. Available from: http://eprints.mdpu.org.ua/id/eprint/8136/.
Cader, A., 2020. The potential for the use of deep neural networks in e-learning student evaluation with new data augmentation method. In: I.I. Bittencourt, M. Cukurova, K. Muldner, R. Luckin and E. Millán, eds. Artificial intelligence in education. Cham: Springer International Publishing, pp.37–42. Available from: https://doi.org/10.1007/978-3-030-52240-7_7. DOI: https://doi.org/10.1007/978-3-030-52240-7_7
Chaban, H. and Kukhtiak, O., 2020. Zastosuvannya aparata teoriyi shtuchnyx nejronnyx merezh u zadachax prykladnoyi pedagogiky zakladiv vyshhoyi osvity [Application of the artificial neural networks theory in problems of applied pedagogy of higher education institutions]. Ukrainian educational journal, 1, pp.51–56. Available from: https://doi.org/10.32405/2411-1317-2020-1-51-56. DOI: https://doi.org/10.32405/2411-1317-2020-1-51-56
Cherniak, O., Sorocolat, N. and Kanytska, I., 2020. Graph analytical method for determining the complex quality indicator of qualimetry objects. Innovative technologies and scientific solutions for industries, 4(14), pp.169–175. Available from: https://doi.org/10.30837/ITSSI.2020.14.169. DOI: https://doi.org/10.30837/ITSSI.2020.14.169
Chervak, O.Y., 2010. Teoriya optymalnogo vyboru. Pidkryteriyi paretivskoyi zgortky kryteriyiv [The theory of optimal choice. Sub-criteria for convolution of Pareto criteria]. Naukovyj visnyk uzhgorodskogo universytetu, 30, pp.28–30. Available from: https://dspace.uzhnu.edu.ua/jspui/handle/lib/7372.
Do, Q.H. and Chen, J.F., 2013. A neuro-fuzzy approach in the classification of students’ academic performance. Computational intelligence and neuroscience, 2013, p.179097. Available from: https://doi.org/10.1155/2013/179097. DOI: https://doi.org/10.1155/2013/179097
Fazlollahtabar, H. and Mahdavi, I., 2009. User/tutor optimal learning path in e-learning using comprehensive neuro-fuzzy approach. Educational research review, 4(2), pp.142–155. Available from: https://doi.org/10.1016/j.edurev.2009.02.001. DOI: https://doi.org/10.1016/j.edurev.2009.02.001
Goodfellow, I., Bengio, Y. and Courville, A., 2016. Deep learning, Adaptive Computation and Machine Learning series. MIT Press. Available from: http://www.deeplearningbook.org.
Grycyuk, Y.I. and Grycyuk, M.Y., 2014. Osoblyvosti multyplikatyvnogo zgortannya chastkovyh kryteriyiv v uzagalnenyj pokaznyk [Features of multiplicative folding of partial criteria into the generalized indicator]. Naukovyj visnyk nltu ukrayiny, 24(11), pp.341–352. Available from: https://cyberleninka.ru/article/n/osoblivosti-multiplikativnogo-zgortannya-chastkovih-kriteriyiv-v-uzagalneniy-pokaznik.
Hammerness, K. and Klette, K., 2015. Indicators of quality in teacher education: Looking at features of teacher education from an international perspective. Promoting and sustaining a quality teacher workforce. Emerald Group Publishing Limited, International Perspectives on Education and Society, vol. 27, pp.239–277. Available from: https://doi.org/10.1108/S1479-367920140000027013. DOI: https://doi.org/10.1108/S1479-367920140000027013
Horal, L., Khvostina, I., Reznik, N., Shiyko, V., Yashcheritsyna, N., Korol, S. and Zaselskiy, V., 2020. Predicting the economic efficiency of the business model of an industrial enterprise using machine learning methods. Ceur workshop proceedings, 2713, pp.334–351. DOI: https://doi.org/10.31812/123456789/4476
Isac, C., Nita, D. and Dura, C., 2010. Optimizing franchising investment decision using Electre and Rompedet methods. The iup journal of managerial economics, 8(1/2), pp.7–32.
Kardan, A.A., Sadeghi, H., Ghidary, S.S. and Sani, M.R.F., 2013. Prediction of student course selection in online higher education institutes using neural network. Computers & education, 65, pp.1–11. Available from: https://doi.org/10.1016/j.compedu.2013.01.015. DOI: https://doi.org/10.1016/j.compedu.2013.01.015
Kirichek, G., Harkusha, V., Timenko, A. and Kulykovska, N., 2019. System for detecting network anomalies using a hybrid of an uncontrolled and controlled neural network. Ceur workshop proceedings, 2546, pp.138–148. DOI: https://doi.org/10.31812/123456789/3743
Kondruk, N.E. and Malyar, M.M., 2019. Bagatokryterialna optymizaciya linijnyh system [Multicriteria optimization of linear systems]. Uzhgorod, Ukraine: RA AUTDOR-ShARK. Available from: https://dspace.uzhnu.edu.ua/jspui/handle/lib/24042.
Lesinski, G., Corns, S. and Dagli, C., 2016. Application of an artificial neural network to predict graduation success at the united states military academy. Procedia computer science, 95, pp.375–382. Available from: https://doi.org/10.1016/j.procs.2016.09.348. DOI: https://doi.org/10.1016/j.procs.2016.09.348
Liu, C., Feng, Y. and Wang, Y., 2022. An innovative evaluation method for undergraduate education: an approach based on bp neural network and stress testing. Studies in higher education, 47(1), pp.212–228. Available from: https://doi.org/10.1080/03075079.2020.1739013. DOI: https://doi.org/10.1080/03075079.2020.1739013
Mahapatra, S.S. and Khan, M.S., 2007. A neural network approach for assessing quality in technical education: an empirical study. International journal of productivity and quality management, 2(3), pp.287–306. Available from: https://doi.org/10.1504/IJPQM.2007.012451. DOI: https://doi.org/10.1504/IJPQM.2007.012451
Markova, O., Semerikov, S. and Popel, M., 2018. CoCalc as a learning tool for neural network simulation in the special course “Foundations of mathematic informatics”. Ceur workshop proceedings, 2104, pp.388–403. Available from: http://ceur-ws.org/Vol-2104/paper_204.pdf. DOI: https://doi.org/10.31812/0564/2250
Müller, B., Reinhardt, J. and Strickland, M.T., 1995. Neural Networks: An Introduction, Physics of Neural Networks. 2nd ed. Springer-Verlag Berlin Heidelberg. Available from: https://doi.org/10.1007/978-3-642-57760-4. DOI: https://doi.org/10.1007/978-3-642-57760-4
Naser, S.A., Zaqout, I., Ghosh, M.A., Atallah, R. and Alajrami, E., 2015. Predicting student performance using artificial neural network: In the faculty of engineering and information technology. International journal of hybrid information technology, 8(2), pp.221–228. Available from: https://doi.org/10.14257/ijhit.2015.8.2.20. DOI: https://doi.org/10.14257/ijhit.2015.8.2.20
Okubo, F., Yamashita, T., Shimada, A. and Ogata, H., 2017. A neural network approach for students’ performance prediction. Proceedings of the seventh international learning analytics & knowledge conference. New York, NY, USA: Association for Computing Machinery, LAK ’17, p.598–599. Available from: https://doi.org/10.1145/3027385.3029479. DOI: https://doi.org/10.1145/3027385.3029479
Osadchyi, V., Kruglyk, V. and Bukreyev, D., 2018. Development of a software product for forecasting the entrance of applicants to higher educational institutions. Ukrainian journal of educational studies and information technology, 6(3), pp.55–69. Available from: https://doi.org/10.32919/uesit.2018.03.06. DOI: https://doi.org/10.32919/uesit.2018.03.06
Pererva, V.V., Lavrentieva, O.O., Lakomova, O.I., Zavalniuk, O.S. and Tolmachev, S.T., 2020. The technique of the use of Virtual Learning Environment in the process of organizing the future teachers’ terminological work by specialty. Ceur workshop proceedings, 2643, pp.321–346. DOI: https://doi.org/10.55056/cte.363
Porokhnya, V. and Ostapenko, O., 2019. Neural network and index forecasting of the strategies of development of the armed forces of Ukraine depending on their own economic opportunities and encroachments of the aggressor states. Ceur workshop proceedings, 2422, pp.111–120. DOI: https://doi.org/10.1051/shsconf/20196504004
Pârvu, I. and Ipate, D.M., 2007. Mathematical model of measuring the quality of services of the higher education institutions. Journal of applied economic sciences, 2(1(2)_Fall2007). Available from: https://EconPapers.repec.org/RePEc:ush:jaessh:v:2:y:2007:i:1(2)_fall2007:5.
Regulations on the accreditation of educational programs, which provide training for higher education, 2019. Available from: https://zakon.rada.gov.ua/laws/show/z0880-19#Text.
Rivas, A., González-Briones, A., Hernández, G., Prieto, J. and Chamoso, P., 2021. Artificial neural network analysis of the academic performance of students in virtual learning environments. Neurocomputing, 423, pp.713–720. Available from: https://doi.org/https://doi.org/10.1016/j.neucom.2020.02.125. DOI: https://doi.org/10.1016/j.neucom.2020.02.125
Shtovba, S.D., 2007. Proektirovanie nechetkikh sistem sredstvami MatLab [Fuzzy systems design of by means of MatLab]. Moscow: Goryachaya Liniya–Telekom. Available from: http://pistunovi.inf.ua/shtovba_proek_nechet_sistem__matlab.pdf.
Shtovba, S.D. and Pankevych, O.D., 2018. Fuzzy technology-based cause detection of structural cracks of stone buildings. Ceur workshop proceedings, 2105, pp.209–218.
Sivanandam, S.N., Sumathi, S. and Deepa, S.N., 2006. Introduction to neural networks using matlab 6.0. New Delhi: Tata McGraw-Hill Education.
Tarasenko, A.O., Yakimov, Y.V. and Soloviev, V.N., 2019. Convolutional neural networks for image classification. Ceur workshop proceedings, 2546, pp.101–114. DOI: https://doi.org/10.31812/123456789/3682
Taylan, O. and Karagözoğlu, B., 2009. An adaptive neuro-fuzzy model for prediction of student’s academic performance. Computers & industrial engineering, 57(3), pp.732–741. Available from: https://doi.org/10.1016/j.cie.2009.01.019. DOI: https://doi.org/10.1016/j.cie.2009.01.019
Valko, N. and Osadchyi, V., 2020. Education individualization by means of artificial neural networks. E3s web of conferences, 166, p.10021. Available from: https://doi.org/10.1051/e3sconf/202016610021. DOI: https://doi.org/10.1051/e3sconf/202016610021
Waheed, H., Hassan, S.U., Aljohani, N.R., Hardman, J., Alelyani, S. and Nawaz, R., 2020. Predicting academic performance of students from vle big data using deep learning models. Computers in human behavior, 104, p.106189. Available from: https://doi.org/10.1016/j.chb.2019.106189. DOI: https://doi.org/10.1016/j.chb.2019.106189
Wächter, B., Kelo, M., Lam, Q., Effertz, P., Jost, C. and Kottowski, S., 2015. University quality indicators: a critical assessment. Directorate General for Internal Policies, Policy Department B: Structural and Cohesion Policies. Available from: https://doi.org/10.2861/426164.
How to Cite
This work is licensed under a Creative Commons Attribution 4.0 International License.