Hackathons in computer science education: monitoring and evaluation of programming projects

Zarema  Seidametova; Zinnur  Abduramanov; Girey  Seydametov

doi:10.55056/etq.5

Authors

Zarema S. Seidametova Crimean State Engineering Pedagogical University https://orcid.org/0000-0001-7643-6386
Zinnur S. Abduramanov Crimean State Engineering Pedagogical University https://orcid.org/0000-0002-2818-4759
Girey S. Seydametov Crimean State Engineering Pedagogical University https://orcid.org/0000-0002-1004-4141

DOI:

https://doi.org/10.55056/etq.5

Keywords:

computer science education, programming project, soft and hard skills, agile methods, hackathon, collaboration

Abstract

There are several ways in making learning activities more engaging and interesting to computer science students. In addition to traditional higher education (curriculum, project-based approaches, lectures, labs), we consider competitive approaches such as hackathons to develop hard and soft skills. Computer science education needs to change requirements for hard and soft skills. In order hard skills university CS education has to capture the changes behind the trends, such as big data, artificial intelligence, cloud computing, etc. Developing soft skills is important teamwork, end-user awareness, collaboration, etc.
This study aims to present the various ways to implement hackathons in the context of CS education. We also present a taxonomy of hackathons based on our experiences and observations from 2016 to the present. We aim to share our lessons learned on the following issues: (1) How can hackathons be designed in CS education to teach students necessary skills and competencies; (2) what kinds of programming projects monitoring and evaluation we need during hackathons.

Downloads

Download data is not yet available.

Abstract views: 926 / PDF views: 287

References

Abduramanov, Z.S., Ibraimov, R.I. and Seydametov, G.S., 2019. Automation of monitoring and verification tools for students on hackathon. Information and computer technologies in economics, education and social sphere. vol. 4 (26), pp.79–86.

Abduramanov, Z.S., Seydametov, G.S. and Ametov, O.M., 2017. Project IT-Academy CSE4S: experience of cooperation of the Applied Informatics Department with the professional IT-community of Crimea. Information and computer technologies in economics, education and social sphere. vol. 1 (15), pp.144–152.

Bolton, W.S., Ng, S., Lam, A., Kinch, J., Parchment, V., Foster, W.P., Zimmermann, M.R., Teh, J.Q., Simpson, A., Sharma, K., Kerstein, R., Burke, J., Chapman, S.J., Culmer, P.R. and Jayne, D.G., 2021. Virtual hackathon to tackle COVID-19 unmet needs. BMJ Innovations, 7(2). Available from: https://doi.org/10.1136/bmjinnov-2020-000456. DOI: https://doi.org/10.1136/bmjinnov-2020-000456

Briscoe, G. and Mulligan, C., 2014. Digital innovation: The hackathon phenomenon. Available from: https://bit.ly/3eNcdpo.

Byrne, J.R., Sullivan, K. and O’Sullivan, K., 2018. Active learning of computer science using a hackathon-like pedagogical model. 2018 Constructionism; Vilnius, Lithuania; Research Council of Lithuania. pp.138–150.

Cobham, D., Gowen, C., Hargrave, B., Jacques, K., Laurel, J. and Ringham, S., 2017. From hackathon to student enterprise: an evaluation of creating successful and sustainable student entrepreneurial activity initiated by a university hackathon. EDULEARN17 Proceedings. IATED, 9th International Conference on Education and New Learning Technologies, pp.789–796. Available from: https://doi.org/10.21125/edulearn.2017.1172. DOI: https://doi.org/10.21125/edulearn.2017.1172

Falk, J., Kannabiran, G. and Hansen, N.B., 2021. What do hackathons do? Understanding participation in hackathons through program theory analysis. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. New York, NY, USA: Association for Computing Machinery. DOI: https://doi.org/10.1145/3411764.3445198

Falk Olesen, J. and Halskov, K., 2020. 10 years of research with and on hackathons. Proceedings of the 2020 ACM Designing Interactive Systems Conference. New York, NY, USA: Association for Computing Machinery, DIS ’20, p.1073–1088. Available from: https://doi.org/10.1145/3357236.3395543. DOI: https://doi.org/10.1145/3357236.3395543

Filippova, A., Trainer, E. and Herbsleb, J.D., 2017. From diversity by numbers to diversity as process: Supporting inclusiveness in software development teams with brainstorming. Proceedings of the 39th International Conference on Software Engineering. IEEE Press, ICSE ’17, p.152–163. Available from: https://doi.org/10.1109/ICSE.2017.22. DOI: https://doi.org/10.1109/ICSE.2017.22

Frey, F.J. and Luks, M., 2016. The innovation-driven hackathon: One means for accelerating innovation. Proceedings of the 21st European Conference on Pattern Languages of Programs. New York, NY, USA: Association for Computing Machinery, EuroPlop ’16. Available from: https://doi.org/10.1145/3011784.3011794. DOI: https://doi.org/10.1145/3011784.3011794

Gama, K., Alencar, B., Calegario, F., Neves, A. and Alessio, P., 2018. A hackathon methodology for undergraduate course projects. 2018 IEEE Frontiers in Education Conference (FIE). pp.1–9. Available from: https://doi.org/10.1109/FIE.2018.8659264. DOI: https://doi.org/10.1109/FIE.2018.8659264

Gama, K., Alencar Gonçalves, B. and Alessio, P., 2018. Hackathons in the formal learning process. Proceedings of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education. New York, NY, USA: Association for Computing Machinery, ITiCSE 2018, p.248–253. Available from: https://doi.org/10.1145/3197091.3197138. DOI: https://doi.org/10.1145/3197091.3197138

Guerrero, C., Mar Leza, M. del, González, Y. and Capó, A. Jaume-i, 2016. Analysis of the results of a hackathon in the context of service-learning involving students and professionals. 2016 International Symposium on Computers in Education (SIIE). pp.1–6. Available from: https://doi.org/10.1109/SIIE.2016.7751857. DOI: https://doi.org/10.1109/SIIE.2016.7751857

Horton, P.A., Jordan, S.S., Weiner, S. and Lande, M., 2018. Project-based learning among engineering students during short-form hackathon events. 2018 ASEE Annual Conference & Exposition. Available from: https://doi.org/10.18260/1-2--30901. DOI: https://doi.org/10.18260/1-2--30901

Imam, A. and Dey, T., 2021. Tracking hackathon code creation and reuse. 2021 2021 IEEE/ACM 18th International Conference on Mining Software Repositories (MSR). Los Alamitos, CA, USA: IEEE Computer Society, pp.615–617. Available from: https://doi.org/10.1109/MSR52588.2021.00085. DOI: https://doi.org/10.1109/MSR52588.2021.00085

Imam, A., Dey, T., Nolte, A., Mockus, A. and Herbsleb, J.D., 2021. The secret life of hackathon code. 2103.01145.

Kollwitz, C. and Dinter, B., 2019. What the hack? – towards a taxonomy of hackathons. In: T. Hildebrandt, B.F. van Dongen, M. Röglinger and J. Mendling, eds. Business Process Management. Cham: Springer International Publishing, pp.354–369. DOI: https://doi.org/10.1007/978-3-030-26619-6_23

Kopeć, W., Balcerzak, B., Nielek, R., Kowalik, G., Wierzbicki, A. and Casati, F., 2018. Older adults and hackathons: a qualitative study. Empirical software engineering, 23(4), pp.1895–1930. Available from: https://doi.org/10.1007/s10664-017-9565-6. DOI: https://doi.org/10.1007/s10664-017-9565-6

Medina Angarita, M.A. and Nolte, A., 2019. Does it matter why we hack? – Exploring the impact of goal alignment in hackathons. Proceedings of 17th European Conference on Computer-Supported Cooperative Work. European Society for Socially Embedded Technologies (EUSSET), pp.1–15. Available from: https://doi.org/10.18420/ecscw2019_ep01.

Medina Angarita, M.A. and Nolte, A., 2020. What do we know about hackathon outcomes and how to support them? – a systematic literature review. In: A. Nolte, C. Alvarez, R. Hishiyama, I.A. Chounta, M.J. Rodríguez-Triana and T. Inoue, eds. Collaboration Technologies and Social Computing. Cham: Springer International Publishing, pp.50–64. DOI: https://doi.org/10.1007/978-3-030-58157-2_4

Mtsweni, J. and Abdullah, H., 2015. Stimulating and maintaining students’ interest in computer science using the hackathon model. The independent journal of teaching and learning, 10(1), pp.85–97. Available from: https://doi.org/10.10520/EJC179017.

Nandi, A. and Mandernach, M., 2016. Hackathons as an informal learning platform. Proceedings of the 47th ACM Technical Symposium on Computing Science Education. New York, NY, USA: Association for Computing Machinery, SIGCSE ’16, p.346–351. Available from: https://doi.org/10.1145/2839509.2844590. DOI: https://doi.org/10.1145/2839509.2844590

Nolte, A., Chounta, I.A. and Herbsleb, J.D., 2020. What happens to all these hackathon projects? Identifying factors to promote hackathon project continuation. Proc. ACM Hum.-Comput. Interact., 4(CSCW2). Available from: https://doi.org/10.1145/3415216. DOI: https://doi.org/10.1145/3415216

Nolte, A., Pe-Than, E.P.P., Filippova, A., Bird, C., Scallen, S. and Herbsleb, J.D., 2018. You hacked and now what? - Exploring outcomes of a corporate hackathon. Proc. ACM Hum.-Comput. Interact., 2(CSCW). Available from: https://doi.org/10.1145/3274398. DOI: https://doi.org/10.1145/3274398

Nolte, A., Pe-Than, E.P.P., Obot Affia, A. amefon, Chaihirunkarn, C., Filippova, A., Kalyanasundaram, A., Angarita, M.A.M., Trainer, E. and Herbsleb, J.D., 2020. How to organize a hackathon – a planning kit. Available from: https://arxiv.org/abs/2008.08025.

Pe-Than, E.P.P., Nolte, A., Filippova, A., Bird, C., Scallen, S. and Herbsleb, J.D., 2019. Designing corporate hackathons with a purpose: The future of software development. IEEE Software, 36(1), pp.15–22. Available from: https://doi.org/10.1109/MS.2018.290110547. DOI: https://doi.org/10.1109/MS.2018.290110547

Pirker, J., Kultima, A. and Gütl, C., 2016. The value of game prototyping projects for students and industry. Proceedings of the International Conference on Game Jams, Hackathons, and Game Creation Events. New York, NY, USA: Association for Computing Machinery, GJH&GC ’16, p.54–57. Available from: https://doi.org/10.1145/2897167.2897180. DOI: https://doi.org/10.1145/2897167.2897180

Porras, J., Khakurel, J., Ikonen, J., Happonen, A., Knutas, A., Herala, A. and Drögehorn, O., 2018. Hackathons in software engineering education: Lessons learned from a decade of events. Proceedings of the 2nd International Workshop on Software Engineering Education for Millennials. New York, NY, USA: Association for Computing Machinery, SEEM ’18, p.40–47. Available from: https://doi.org/10.1145/3194779.3194783. DOI: https://doi.org/10.1145/3194779.3194783

Rainville, B., 2015. Creating value for teachers: Product development at the intersection of education and technology. Doctoral dissertation. Harvard Graduate School of Education. Available from: https://dash.harvard.edu/handle/1/16645022.

Saravi, S., Joannou, D., Kalawsky, R.S., King, M.R.N., Marr, I., Hall, M., Wright, P.C.J., Ravindranath, R. and Hill, A., 2018. A systems engineering hackathon – a methodology involving multiple stakeholders to progress conceptual design of a complex engineered product. IEEE Access, 6, pp.38399–38410. Available from: https://doi.org/10.1109/ACCESS.2018.2851384. DOI: https://doi.org/10.1109/ACCESS.2018.2851384

Striuk, A.M., 2018. Software engineering: First 50 years of formation and development. CEUR Workshop Proceedings, 2292, pp.11–36. DOI: https://doi.org/10.31812/123456789/2880

Uys, W.F., 2020. Hackathons as a formal teaching approach in information systems capstone courses. In: B. Tait, J. Kroeze and S. Gruner, eds. ICT Education. Cham: Springer International Publishing, pp.79–95. DOI: https://doi.org/10.1007/978-3-030-35629-3_6

Varava, I.P., Bohinska, A.P., Vakaliuk, T.A. and Mintii, I.S., 2021. Soft skills in software engineering technicians education. Journal of physics: Conference series, 1946(1), p.012012. Available from: https://doi.org/10.1088/1742-6596/1946/1/012012. DOI: https://doi.org/10.1088/1742-6596/1946/1/012012