Computerized adaptive testing in educational electronic environment of maritime higher education institutions

Olena S. Diahyleva; Igor V. Gritsuk; Olena Y. Kononova; Alona Y. Yurzhenko

doi:10.55056/cte.297

Authors

Olena S. Diahyleva Kherson State Maritime Academy https://orcid.org/0000-0003-3741-4066
Igor V. Gritsuk Kherson State Maritime Academy https://orcid.org/0000-0001-7065-6820
Olena Y. Kononova Maritime College of Kherson State Maritime Academy https://orcid.org/0000-0003-0403-7292
Alona Y. Yurzhenko Kherson State Maritime Academy https://orcid.org/0000-0002-6560-4601

DOI:

https://doi.org/10.55056/cte.297

Keywords:

distance learning, educational electronic environment, maritime higher education, LMS Moodle, computerized adaptive testing, English for specific purposes

Abstract

The article is devoted to the organization of modern learning process, namely the use of innovative technologies – computerized adaptive testing in educational electronic environment of maritime higher education institutions. The example of educational electronic environment is presented in the article on LMS Moodle. The provided new technological and methodological opportunities are a priority in the developed methods of control and testing of knowledge, skills and abilities of students. Comparative characteristic of using computerized adaptive testing in educational electronic environment is given in the article according to different criteria: the role of tests in the learning process; methods of training; equipment; presence of the problems in educational process; level of its control and learning outcomes. The paper also presents examples of activities to form communicative competency of future maritime professionals. Types of adaptive tests are listed in the paper. The research activities were done by second year cadets of ship engineering department of Maritime College of Kherson State Maritime Academy. The experiment was devoted to the formation of communicative competence with the help of electronic environment of maritime higher education institution. The results of experiment proved positive impact of computerized adaptive testing on communicative competence of future ship engineers. Further investigation of adaptive testing can also be done for learning system of maritime education establishments using simulation technologies of virtual, augmented and mixed realities.

Downloads

Download data is not yet available.

Abstract views: 511 / PDF views: 198

References

Abdula, A., Baluta, H., Kozachenko, N. and Kassim, D., 2020. Peculiarities of using of the Moodle test tools in philosophy teaching. Ceur workshop proceedings, 2643, pp.306–320. DOI: https://doi.org/10.55056/cte.362

Activities, 2020. Available from: https://docs.moodle.org/39/en/Activities.

Albano, A., Cai, L., Lease, E. and McConnell, S., 2019. Computerized adaptive testing in early education: Exploring the impact of item position effects on ability estimation. Journal of educational measurement, 56(2), pp.437–451. Available from: https://doi.org/10.1111/jedm.12215. DOI: https://doi.org/10.1111/jedm.12215

Austin, E., Henson, A., Kim, H., Ogle, K. and Park, H., 2021. Analysis of computer adaptive testing in a pathopharmacology course. Journal of nursing education, 60(3), pp.155–158. Available from: https://doi.org/10.3928/01484834-20210222-06. DOI: https://doi.org/10.3928/01484834-20210222-06

Avanesov, V., 2004. Scientific problems of test control. Moscow: MSU.

Balogh, Z., Turcáni, M. and Burianová, M., 2019. Personalized learning and current technologies in teaching it related subjects. 2019 international symposium on educational technology (iset). pp.124–126. Available from: https://doi.org/10.1109/ISET.2019.00034. DOI: https://doi.org/10.1109/ISET.2019.00034

Bradác, V. and Klimes, C., 2013. Language e-learning based on adaptive decision-making system. Proceedings of the european conference on e-learning, ecel. pp.48–57.

Cetin-Berber, D., Sari, H. and Huggins-Manley, A., 2019. Imputation methods to deal with missing responses in computerized adaptive multistage testing. Educational and psychological measurement, 79(3), pp.495–511. Available from: https://doi.org/10.1177/0013164418805532. DOI: https://doi.org/10.1177/0013164418805532

Chelishkova, M.B., 2001. Adaptive testing in education (theory, methodology, technology). Moscow: Research Center for Problems of Preparing Specialists.

Collares, C. and Cecilio-Fernandes, D., 2019. When i say . . . computerised adaptive testing. Medical education, 53(2), pp.115–116. Available from: https://doi.org/10.1111/medu.13648. DOI: https://doi.org/10.1111/medu.13648

Comenius, J., 1993. La conception de l’éducation des jeunes enfants selon. International journal of early childhood, 25(2), pp.60–64. Available from: https://doi.org/10.1007/BF03185620. DOI: https://doi.org/10.1007/BF03185620

Computer adaptive testing: Background, benefits and case study of a large-scale national testing programme, 2019. Available from: https://tinyurl.com/w5925sct.

Computerized adaptive testing, 2020. Available from: https://assess.com/adaptive-testing/.

Diesterweg, A., 1875. Wegweiser zur bildung für deutsche lehrer: Ii, vol. 2. Bädeker.

Fedoruk, P., 2009. Technology of learning process construction in adaptive systems of distance learning. Proceedings of the 12th iasted international conference on computers and advanced technology in education, cate 2009. St. Thomas, pp.228–230.

Haranin, O. and Moiseienko, N., 2018. Adaptive artificial intelligence in RPG-game on the Unity game engine. Ceur workshop proceedings, 2292, pp.143–150. DOI: https://doi.org/10.31812/123456789/2891

Istiyono, E., Dwandaru, W., Setiawan, R. and Megawati, I., 2020. Developing of computerized adaptive testing to measure physics higher order thinking skills of senior high school students and its feasibility of use. European journal of educational research, 9(1), pp.91–101. Available from: https://doi.org/10.12973/eu-jer.9.1.91. DOI: https://doi.org/10.12973/eu-jer.9.1.91

Kang, H.A., Zheng, Y. and Chang, H.H., 2020. Online calibration of a joint model of item responses and response times in computerized adaptive testing. Journal of educational and behavioral statistics, 45(2), pp.175–208. Available from: https://doi.org/10.3102/1076998619879040. DOI: https://doi.org/10.3102/1076998619879040

Kolesnichenko, N., Hladun, T., Diahyleva, O., Hats, L. and Karnaukhova, A., 2020. Increasing students’ motivation to learn at tertiary educational institutions. International journal of higher education, 9(7), pp.166–175. Available from: https://doi.org/10.5430/ijhe.v9n7p166. DOI: https://doi.org/10.5430/ijhe.v9n7p166

Kozmina, I., Lukyantsev, D. and Musorina, O., 2020. Computer adaptive testing as an automated control of students’ level of preparadness taking into account their individual characteristics. Institute of Electrical and Electronics Engineers Inc. Available from: https://doi.org/10.1109/Inforino48376.2020.9111661. DOI: https://doi.org/10.1109/Inforino48376.2020.9111661

Kudryavtseva, V., Malakhivska, T., Moroz, O., Petrovska, Y. and Frolova, O., 2018. Welcome aboard: coursebook. Kherson: STAR.

Lavrynenko, S., Krymets, L., Leshchenko, A., Chaika, Y. and Holovina, O., 2020. Purpose and features of teaching philosophical disciplines at tertiary educational institutions while training specialists of various knowledge areas. International journal of higher education, 9(7), pp.321–331. Available from: https://doi.org/10.5430/ijhe.v9n7p321. DOI: https://doi.org/10.5430/ijhe.v9n7p321

Lebedenko, Y., Danyk, V. and Krupitsa, P., 2016. Adaptive control of the combined propulsion system. 2016 4th international conference on methods and systems of navigation and motion control (msnmc). pp.214–217. Available from: https://doi.org/10.1109/MSNMC.2016.7783145. DOI: https://doi.org/10.1109/MSNMC.2016.7783145

Lin, C.J. and Chang, H.H., 2019. Item selection criteria with practical constraints in cognitive diagnostic computerized adaptive testing. Educational and psychological measurement, 79(2), pp.335–357. Available from: https://doi.org/10.1177/0013164418790634. DOI: https://doi.org/10.1177/0013164418790634

Linden, W. van der and Choi, S., 2020. Improving item-exposure control in adaptive testing. Journal of educational measurement, 57(3), pp.405–422. Available from: https://doi.org/10.1111/jedm.12254. DOI: https://doi.org/10.1111/jedm.12254

Linden, W. van der and Ren, H., 2020. A fast and simple algorithm for bayesian adaptive testing. Journal of educational and behavioral statistics, 45(1), pp.58–85. Available from: https://doi.org/10.3102/1076998619858970. DOI: https://doi.org/10.3102/1076998619858970

Lord, F.M., 2012. Application of Item Response Theory to Practical Testing Problems. Routledge. DOI: https://doi.org/10.4324/9780203056615

Mintii, I., Shokaliuk, S., Vakaliuk, T., Mintii, M. and Soloviev, V., 2019. Import test questions into Moodle LMS. Ceur workshop proceedings, 2433, pp.529–540. DOI: https://doi.org/10.55056/cte.411

Model course 3.17. maritime english, 2015. 2015th ed. International Maritime Organization.

Open Assessment Technologies, 2020. Using adaptive testing in digital assessment to support learning. Available from: https://www.taotesting.com/blog/using-adaptive-testing-in-digital-assessment-to-support-learning/.

Osadcha, K., Osadchyi, V., Semerikov, S., Chemerys, H. and Chorna, A., 2020. The review of the adaptive learning systems for the formation of individual educational trajectory. Ceur workshop proceedings, 2732, pp.547–558. DOI: https://doi.org/10.31812/123456789/4130

Paap, M., Born, S. and Braeken, J., 2019. Measurement efficiency for fixed-precision multidimensional computerized adaptive tests: Comparing health measurement and educational testing using example banks. Applied psychological measurement, 43(1), pp.68–83. Available from: https://doi.org/10.1177/0146621618765719. DOI: https://doi.org/10.1177/0146621618765719

Pestalozzi, J., Piaget, J. and Froebel, F., 2014. Conversation 4: How do young children learn? Early childhood education: History, philosophy and experience. 2nd ed. SAGE Publications Inc., pp.98–104. Available from: https://doi.org/10.4135/9781446288863. DOI: https://doi.org/10.4135/9781446288863

Petrova, M., Mintii, M., Semerikov, S. and Volkova, N., 2018. Development of adaptive educational software on the topic of “Fractional Numbers” for students in grade 5. Ceur workshop proceedings, 2292, pp.162–192. DOI: https://doi.org/10.31812/123456789/2894

Polhun, K., Kramarenko, T., Maloivan, M. and Tomilina, A., 2021. Shift from blended learning to distance one during the lockdown period using Moodle: test control of students’ academic achievement and analysis of its results. Journal of physics: Conference series, 1840(1), p.012053. Available from: https://doi.org/10.1088/1742-6596/1840/1/012053. DOI: https://doi.org/10.1088/1742-6596/1840/1/012053

Popova, H. and Yurzhenko, A., 2019. Competency framework as an instrument to assess professional competency of future seafarers. Ceur workshop proceedings, 2387, pp.409–413.

Samsudin, M., Somchut, T. and Ismail, M., 2019. Evaluating computerized adaptive testing efficiency in measuring students’ performance in science timss. Jurnal pendidikan ipa indonesia, 8(4), pp.547–560. Available from: https://doi.org/10.15294/jpii.v8i4.19417. DOI: https://doi.org/10.15294/jpii.v8i4.19417

Shapovalova, N., Rybalchenko, O., Dotsenko, I., Bilashenko, S., Striuk, A. and Saitgareev, L., 2019. Adaptive testing model as the method of quality knowledge control individualizing. Ceur workshop proceedings, 2393, pp.984–999. DOI: https://doi.org/10.31812/123456789/3174

Souki, A.M., Paraskeva, F., Alexiou, A. and Papanikolaou, K.A., 2015. Developing personalised e-courses: Tailoring students’ learning preferences to a model of self-regulated learning. Int. j. learn. technol., 10(3), p.188–202. Available from: https://doi.org/10.1504/IJLT.2015.072357. DOI: https://doi.org/10.1504/IJLT.2015.072357

Susanti, Y., Tokunaga, T. and Nishikawa, H., 2020. Integrating automatic question generation with computerised adaptive test. Research and practice in technology enhanced learning, 15(1), p.9. Available from: https://doi.org/10.1186/s41039-020-00132-w. DOI: https://doi.org/10.1186/s41039-020-00132-w

Tyshchenko, Y. and Striuk, A., 2018. The relevance of developing a model of adaptive learning. Ceur workshop proceedings, 2292, pp.109–115.

Vasil’ev, V. and Tyagunova, T., 2003. Fundamentals of the culture of adaptive testing. Moscow: IKAR.

Voloshynov, S., Popova, H., Yurzhenko, A. and Shmeltser, E., 2020. The use of digital escape room in educational electronic environment of maritime higher education institutions. Ceur workshop proceedings, 2643, pp.347–359. DOI: https://doi.org/10.55056/cte.364

Wang, W., Song, L., Wang, T., Gao, P. and Xiong, J., 2020. A note on the relationship of the shannon entropy procedure and the jensen–shannon divergence in cognitive diagnostic computerized adaptive testing. Sage open, 10(1). Available from: https://doi.org/10.1177/2158244019899046. DOI: https://doi.org/10.1177/2158244019899046

Winkley, J., 2020. Adaptive testing. Available from: https://www.e-assessment.com/news/adaptive-testing/.

Wright, B.D. and Stone, M.H., 1979. Best test design. Mesa Press.

Yasuda, J.I., Mae, N., Hull, M. and Taniguchi, M.A., 2021. Optimizing the length of computerized adaptive testing for the force concept inventory. Physical review physics education research, 17(1). Available from: https://doi.org/10.1103/PhysRevPhysEducRes.17.010115. DOI: https://doi.org/10.1103/PhysRevPhysEducRes.17.010115

Yurzhenko, A.Y., 2019. An e-course based on the LMS Moodle to teach “Maritime English for professional purpose”. Information technologies and learning tools, 71(3), pp.92–101. Available from: https://doi.org/10.33407/itlt.v71i3.2512. DOI: https://doi.org/10.33407/itlt.v71i3.2512