10.1145/3430665.3456306acmconferencesArticle/Chapter ViewAbstractPublication PagesiticseConference Proceedings
research-article

Supporting CS1 Instructors: Design and Evaluation of a Game Generator

Published:26 June 2021

ABSTRACT

Serious games have shown much promise in education, including in the teaching of programming. However, instructors who teach introductory programming often do not have the specialised skills to create serious games. One way to address this problem is to use domain-specific game generators to create customised games as needed. This paper presents the design and empirical evaluation of a prototype game generator tool - the Recursive Game Generator. 30 programming instructors evaluated the tool and found it useful (87%), easy to use and learn (80%); and were satisfied with the tool's effectiveness and efficiency. Their positive experiences suggest that such a higher-order tool has the potential to increase the adoption of serious games in programming education, and broadly meet the needs of a diverse audience of instructors.

References

  1. William Albert and Thomas Tullis. 2013. Measuring the user experience: collecting, analyzing, and presenting usability metrics. Newnes.Google ScholarGoogle ScholarOpenURL University of Cape Town
  2. Jecton Tocho Anyango and Hussein Suleman. 2018. Teaching Programming in Kenya and South Africa: What is difficult and is it universal?. In Proceedings of the 18th Koli Calling International Conference on Computing Education Research. 1--2.Google ScholarGoogle ScholarDigital LibraryDigital LibraryOpenURL University of Cape Town
  3. Johan Baldeón, Anna Puig, Inmaculada Rodríguez, Cristian Muriel, and Leandro Zardain. 2017. A ConceptualModel for Educational Game Authoring: A Showcase in Math Games. In Design, User Experience, and Usability: Designing Pleasurable Experiences, Aaron Marcus and Wentao Wang (Eds.). Springer International Publishing, Cham, 347--361.Google ScholarGoogle ScholarOpenURL University of Cape Town
  4. Yosra Bouzid, Mohamed Ali Khenissi, and Mohamed Jemni. 2015. Designing a game generator as an educational technology for the deaf learners. In Information & Communication Technology and Accessibility (ICTA), 2015 5th International Conference on. IEEE, 1--6.Google ScholarGoogle ScholarCross RefCross RefOpenURL University of Cape Town
  5. A Chaffin, Katelyn Doran, Drew Hicks, and Tiffany Barnes. 2009. Experimental evaluation of teaching recursion in a video game. In In Proceedings of the 2009 ACM SIGGRAPH Symposium on Video Games, Sandbox '09. ACM, 79--86.Google ScholarGoogle ScholarDigital LibraryDigital LibraryOpenURL University of Cape Town
  6. Stephen Cooper, Wanda Dann, and Randy Pausch. 2000. Alice: a 3-D tool for introductory programming concepts. Journal of computing sciences in colleges 15, 5 (2000), 107--116.Google ScholarGoogle ScholarDigital LibraryDigital LibraryOpenURL University of Cape Town
  7. Matteo Gaeta, Vincenzo Loia, Giuseppina Rita Mangione, Francesco Orciuoli, Pierluigi Ritrovato, and Saverio Salerno. 2014. A methodology and an authoring tool for creating Complex Learning Objects to support interactive storytelling. Computers in Human Behavior 31 (2014), 620--637.Google ScholarGoogle ScholarDigital LibraryDigital LibraryOpenURL University of Cape Town
  8. Roslina Ibrahim and Azizah Jaafar. 2009. Educational games (EG) design framework: Combination of game design, pedagogy and content modeling. In 2009 International Conference on Electrical Engineering and Informatics, Vol. 1. IEEE, 293--298.Google ScholarGoogle ScholarCross RefCross RefOpenURL University of Cape Town
  9. Chris Johnson, Monica McGill, Durell Bouchard, Michael K. Bradshaw, Víctor A. Bucheli, Laurence D. Merkle, Michael James Scott, Z. Sweedyk, J. Ángel Velázquez- Iturbide, Zhiping Xiao, and Ming Zhang. 2016. Game Development for Computer Science Education. In Proceedings of the 2016 ITiCSE Working Group Reports (Arequipa, Peru) (ITiCSE '16). Association for Computing Machinery, New York, NY, USA, 23--44. https://doi.org/10.1145/3024906.3024908Google ScholarGoogle ScholarOpenURL University of Cape Town
  10. Aous Karoui, Iza Marfisi-Schottman, and Sébastien George. 2017. A Nested Design Approach for Mobile Learning Games. In Proceedings of the 16th World Conference on Mobile and Contextual Learning (Larnaca, Cyprus) (mLearn 2017). Association for Computing Machinery, New York, NY, USA, Article 4, 4 pages. https://doi.org/10.1145/3136907.3136923Google ScholarGoogle ScholarDigital LibraryDigital LibraryOpenURL University of Cape Town
  11. Mohamed Ali Khenissi, Fathi Essalmi, and Mohamed Jemni. 2015. Comparison between serious games and learning version of existing games. Procedia-Social and Behavioral Sciences 191 (2015), 487--494.Google ScholarGoogle ScholarCross RefCross RefOpenURL University of Cape Town
  12. Devorah Kletenik and Deborah Sturm. 2018. Game Development with a Serious Focus (SIGCSE '18). Association for Computing Machinery, New York, NY, USA, 652--657. https://doi.org/10.1145/3159450.3159588Google ScholarGoogle ScholarOpenURL University of Cape Town
  13. Gao M Kortum P and Oswald F. 2018. Psychometric Evaluation of the USE (Usefulness, Satisfaction, and Ease of use) Questionnaire for Reliability and Validity. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting. 1414--1418.Google ScholarGoogle ScholarOpenURL University of Cape Town
  14. Essi Lahtinen, Kirsti Ala-Mutka, and Hannu-Matti Järvinen. 2005. A study of the difficulties of novice programmers. Acm sigcse bulletin 37, 3 (2005), 14--18.Google ScholarGoogle ScholarOpenURL University of Cape Town
  15. ArnoldMLund. 2001. Measuring usability with the use questionnaire12. Usability interface 8, 2 (2001), 3--6.Google ScholarGoogle ScholarOpenURL University of Cape Town
  16. Martin Maguire. 2001. Context of use within usability activities. International Journal of Human-Computer Studies 55, 4 (2001), 453--483.Google ScholarGoogle ScholarDigital LibraryDigital LibraryOpenURL University of Cape Town
  17. Sohail Iqbal Malik and Jo Coldwell-Neilson. 2017. A model for teaching an introductory programming course using ADRI. Education and Information Technologies 22, 3 (2017), 1089--1120.Google ScholarGoogle ScholarDigital LibraryDigital LibraryOpenURL University of Cape Town
  18. Eugenio J Marchiori, Javier Torrente, Ángel del Blanco, Pablo Moreno-Ger, Pilar Sancho, and Baltasar Fernández-Manjón. 2012. A narrative metaphor to facilitate educational game authoring. Computers & Education 58, 1 (2012), 590--599.Google ScholarGoogle ScholarDigital LibraryDigital LibraryOpenURL University of Cape Town
  19. Florian Mehm. 2010. Authoring Serious Games. In Proceedings of the Fifth International Conference on the Foundations of Digital Games (Monterey, California) (FDG '10). Association for Computing Machinery, New York, NY, USA, 271--273. https://doi.org/10.1145/1822348.1822390Google ScholarGoogle ScholarDigital LibraryDigital LibraryOpenURL University of Cape Town
  20. Clive Nancarrow and Ian Brace. 2000. Saying the "right thing": Coping with social desirability bias in marketing research. Bristol Business School Teaching and Research Review 3, 11 (2000), 1--11.Google ScholarGoogle ScholarOpenURL University of Cape Town
  21. Jakob Nielsen. 1994. Usability engineering. Morgan Kaufmann.Google ScholarGoogle ScholarOpenURL University of Cape Town
  22. Joseph C Osborn, Melanie Dickinson, Barrett Anderson, Adam Summerville, Jill Denner, David Torres, Noah Wardrip-Fruin, and Michael Mateas. 2019. Is Your Game Generator Working? Evaluating Gemini, an Intentional Generator. In Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, Vol. 15. 59--65.Google ScholarGoogle ScholarOpenURL University of Cape Town
  23. José Carlos Paiva, Ricardo Queirós, José Paulo Leal, and Jakub Swacha. 2020. FGPE AuthorKit -- A Tool for Authoring Gamified Programming Educational Content. In Proceedings of the 2020 ACM Conference on Innovation and Technology in Computer Science Education (Trondheim, Norway) (ITiCSE '20). Association for Computing Machinery, New York, NY, USA, 564. https://doi.org/10.1145/3341525.3393978Google ScholarGoogle ScholarDigital LibraryDigital LibraryOpenURL University of Cape Town
  24. Kaska Porayska-Pomsta, Keith Anderson, Sara Bernardini, Karen Guldberg, Tim Smith, Lila Kossivaki, Scott Hodgins, and Ian Lowe. 2013. Building an intelligent, authorable serious game for autistic children and their carers. In International Conference on Advances in Computer Entertainment Technology. Springer, 456-- 475.Google ScholarGoogle ScholarCross RefCross RefOpenURL University of Cape Town
  25. V. M. Pérez-Colado, I. J. Pérez-Colado, M. Freire-Morán, I. Martínez-Ortiz, and B. Fernández-Manjón. 2019. uAdventure: Simplifying Narrative Serious Games Development. In 2019 IEEE 19th International Conference on Advanced Learning Technologies (ICALT), Vol. 2161--377X. 119--123.Google ScholarGoogle ScholarOpenURL University of Cape Town
  26. Arturo Barajas Saavedra, Francisco J. Álvarez Rodríguez, Jaime Muñoz Arteaga, René Santaolaya Salgado, and César A. Collazos Ordoñez. 2014. A Serious Game Development Process Using Competency Approach: Case Study: Elementary School Math. In Proceedings of the XV International Conference on Human Computer Interaction (Puerto de la Cruz, Tenerife, Spain) (Interacción '14). ACM, New York, NY, USA, Article 99, 9 pages. https://doi.org/10.1145/2662253.2662352Google ScholarGoogle ScholarOpenURL University of Cape Town
  27. Jeff Sauro and James R Lewis. 2016. Quantifying the user experience: Practical statistics for user research. Morgan Kaufmann.Google ScholarGoogle ScholarOpenURL University of Cape Town
  28. Alexis Sepchat, Nicolas Monmarché, Mohamed Slimane, and Dominique Archambault. 2006. Semi automatic generator of tactile video games for visually impaired children. In International Conference on Computers for Handicapped Persons. Springer, 372--379.Google ScholarGoogle ScholarDigital LibraryDigital LibraryOpenURL University of Cape Town
  29. Esther Shein. 2015. Python for beginners.Google ScholarGoogle ScholarOpenURL University of Cape Town
  30. Javier Torrente, Ángel Del Blanco, Eugenio J Marchiori, Pablo Moreno-Ger, and Baltasar Fernández-Manjón. 2010. e-Adventure: Introducing educational games in the learning process. In IEEE EDUCON 2010 Conference. IEEE, 1121-- 1126.Google ScholarGoogle ScholarCross RefCross RefOpenURL University of Cape Town
  31. Javier Torrente, Pablo Moreno-Ger, Baltasar Fernández-Manjón, and José Luis Sierra. 2008. Instructor-oriented authoring tools for educational videogames. In 2008 Eighth IEEE International Conference on Advanced Learning Technologies. IEEE, 516--518.Google ScholarGoogle ScholarDigital LibraryDigital LibraryOpenURL University of Cape Town
  32. Javier Torrente, Ángel Serrano-Laguna, Conor Fisk, Breid O'Brien, Wanda Alesky, Baltasar Fernández-Manjón, and Patty Kostkova. 2015. Introducing Mokap: A Novel Approach to Creating Serious Games. In Proceedings of the 5th International Conference on Digital Health 2015 (Florence, Italy) (DH '15). ACM, New York, NY, USA, 17--24. https://doi.org/10.1145/2750511.2750529Google ScholarGoogle ScholarDigital LibraryDigital LibraryOpenURL University of Cape Town
  33. Irene Visscher-Voerman and Kent L Gustafson. 2004. Paradigms in the theory and practice of education and training design. Educational Technology Research and Development 52, 2 (2004), 69--89.Google ScholarGoogle ScholarCross RefCross RefOpenURL University of Cape Town
  34. Rebekah Willson. 2019. Analysing Qualitative Data: You Asked Them, Now What to Do With What They Said. In Proceedings of the 2019 Conference on Human Information Interaction and Retrieval (Glasgow, Scotland UK) (CHIIR '19). ACM, New York, NY, USA, 385--387. https://doi.org/10.1145/3295750.3298964Google ScholarGoogle ScholarDigital LibraryDigital LibraryOpenURL University of Cape Town

Index Terms

  1. Supporting CS1 Instructors: Design and Evaluation of a Game Generator

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Article Metrics

    • Downloads (Last 12 months)29
    • Downloads (Last 6 weeks)29

    Other Metrics

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader
About Cookies On This Site

We use cookies to ensure that we give you the best experience on our website.

Learn more

Got it!