Co-designing Gamified Intelligent Tutoring Systems with Teachers

Diego Dermeval, Ig Ibert Bittencourt

Resumo


Researchers are increasingly interested in Gamified Intelligent Tutoring Systems (ITSs) to provide adaptive instruction and to enhance engagement of students. However, although teachers are demanding to be active users of gamified ITS, they have been not considered as first-class citizens in the design of these kinds of systems. In order to contribute to the active and customized use of gamified ITS by teachers, three technical problems should be considered. First, designing ITS is very complex (i.e., considering different theories, components, and stakeholders) and including gamification may significantly increase such complexity and variability. Second, gamified ITS features can be used depending on several elements (e.g., educational level, knowledge domain, gamification and ITS theories, etc). Thus, it is imperative to take advantage of theories and practices from both topics to reduce the design space of these systems. Third, in order to effectively aid teachers to actively use such systems, it is needed to provide a simple and usable solution for them. To target these problems, in this paper, we present a solution for authoring gamified ITS by teachers that makes use of an ontology-based feature model (OntoSPL) to deal with the variability at runtime and takes advantage of an ontology (GaTO) that connects gamified ITS theories and design practices to constrain the variability space for designing these systems. Our main results indicate that teachers have a high acceptance level (i.e., ease of use, usability, and low complexity) in the design of gamified ITS using the authoring solution, customizing their own gamified tutors in less than five minutes. These results indicate a promising way to explore the use of authoring tools, ontologies, and software engineering to take advantage of both artificial intelligence techniques (mainly for aiding adaptation for students) as well as on the human intelligence of teachers to co-design gamified intelligent tutoring systems.

Palavras-chave


Intelligent Tutoring Systems;Gamification; Authoring Tools

Texto completo:

PDF (English)

Referências


Abbas, M. A., Ahmad, W. F. W., & Kalid, K. S. (2014). Semantic Web Technologies for Pre-School Cognitive Skills Tutoring System. Journal of information science and engineering, 30(3), 835–851. [GS Search]

Aleven, V., McLaren, B. M., & Sewall, J. (2009). Scaling Up Programming by Demonstration for Intelligent Tutoring Systems Development: An Open-Access Web Site for Middle School Mathematics Learning. Learning Technologies, IEEE Transactions on, 2(2), 64–78. [DOI: https://doi.org/10.1109/TLT.2009.22.] [GS Search]

Aleven, V., McLaren, B. M., Sewall, J., van Velsen, M., Popescu, O., Demi, S., . . . Koedinger, K. R. (2016). Example-tracing tutors: Intelligent tutor development for non-programmers. International Journal of Artificial Intelligence in Education, 26(1), 224–269. [DOI: https://doi.org/10.1007/s40593-015-0088-2.] [GS Search]

Andrade, F. R. H., Mizoguchi, R., & Isotani, S. (2016). The bright and dark sides of gamification. In A. Micarelli, J. Stamper, & K. Panourgia (Eds.), Intelligent tutoring systems: 13th international conference, its 2016, zagreb, croatia, june 7-10, 2016. proceedings (pp. 176–186). Cham: Springer International Publishing. [DOI: https://doi.org/10.1007/978-3-319-39583-8_17.] [GS Search]

Baker, R. S., D’Mello, S. K., Rodrigo, M. M. T., & Graesser, A. C. (2010). Better to be frustrated than bored: The incidence, persistence, and impact of learners’ cognitive–affective states during interactions with three different computer-based learning environments. International Journal of Human-Computer Studies, 68(4), 223–241. [DOI: https://doi.org/10.1016/j.ijhcs.2009.12.003.] [GS Search]

Bandeira, J., Bittencourt, I. I., Espinheira, P., & Isotani, S. (2016). Foca: A methodology for ontology evaluation. arXiv preprint arXiv:1612.03353. [GS Search]

Beck, J., Stern, M., & Haugsjaa, E. (1996). Applications of ai in education. Crossroads, 3(1), 11–15. [DOI: https://doi.org/10.1145/332148.33215.] [GS Search]

Bittencourt, I. I., Costa, E., Silva, M., & Soares, E. (2009). A computational model for developing semantic web-based educational systems. Knowledge-Based Systems, 22(4), 302 - 315. [DOI: http://dx.doi.org/10.1016/j.knosys.2009.02.012.] [GS Search]

Blessing, S. B., Gilbert, S. B., Ourada, S., & Ritter, S. (2009). Authoring model-tracing cognitive tutors. International Journal of Artificial Intelligence in Education, 19(2), 189–210. [DOI: https://dl.acm.org/doi/10.5555/1734243.1734247.] [GS Search]

Brawner, K. W. (2015). Rapid dialogue and branching tutors. In Proceedings of the workshops at the 17th international conference on artificial intelligence in education, AIED 2015, madrid, spain, june 22 + 26, 2015. [GS Search]

Clements, P. C., & Northrop, L. (2001). Software product lines: Practices and patterns. Addison- Wesley. [GS Search]

Czarnecki, K., Peter Kim, C. H., & Kalleberg, K. T. (2006). Feature models are views on ontologies. In Proceedings of the 10th international on software product line conference (pp. 41–51). Washington, DC, USA: IEEE Computer Society. [DOI: https://doi.org/10.1109/SPLINE.2006.1691576.] [GS Search]

Dag, F., Durdu, L., & Gerdan, S. (2014). Evaluation of educational authoring tools for teachers stressing of perceived usability features. Procedia-Social and Behavioral Sciences, 116, 888–901. [DOI: https://doi.org/10.1016/j.sbspro.2014.01.316.] [GS Search]

Dermeval, D., Tenório, T., Bittencourt, I. I., Silva, A., Isotani, S., & Ribeiro, M. (2015). Ontology-based feature modeling: An empirical study in changing scenarios. Expert Systems with Applications, 42(11), 4950–4964. [DOI: https://doi.org/10.1016/j.eswa.2015.02.020.] [GS Search]

Dermeval, D., & Bittencourt, I. I. (2017). Authoring gamified intelligent tutoring systems. In Anais dos Workshops do Congresso Brasileiro de Informática na Educação (Vol. 6, No. 1, p. 14). [DOI: http://dx.doi.org/10.5753/cbie.wcbie.2017.14.] [GS Search]

Dermeval, D., Paiva, R., Bittencourt, I. I., Vassileva, J., & Borges, D. (2018). Authoring tools for designing intelligent tutoring systems: a systematic review of the literature. International Journal of Artificial Intelligence in Education, 1–49. [DOI: https://doi.org/10.1007/s40593-017-0157-9.] [GS Search]

de Sousa Borges, S., Durelli, V. H., Reis, H. M., & Isotani, S. (2014). A systematic mapping on gamification applied to education. In Proceedings of the 29th annual acm symposium on applied computing (pp. 216–222). [DOI: https://doi.org/10.1145/2554850.2554956.] [GS Search]

Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011). From game design elements to gamefulness: defining gamification. In Proceedings of the 15th international academic mindtrek conference: Envisioning future media environments (pp. 9–15). [DOI: https://doi.org/10.1145/2181037.2181040.] [GS Search]

Dillenbourg, P., & Self, J. (1992). A framework for learner modelling. Interactive Learning Environments, 2(2), 111–137. [DOI: https://doi.org/10.1080/1049482920020202.] [GS Search]

Du Boulay, B. (2016). Recent meta-reviews and meta–analyses of aied systems. International Journal of Artificial Intelligence in Education, 26(1), 536–537. [DOI: https://doi.org/10.1007/s40593-015-0060-.] [GS Search]

Du Boulay, B., & Luckin, R. (2001). Modelling human teaching tactics and strategies for tutoring systems. International Journal of Artificial Intelligence in Education, 12(3), 235–256. [DOI: https://doi.org/10.1007/s40593-015-0053-0.] [GS Search]

Escudero, H., & Fuentes, R. (2010). Exchanging courses between different Intelligent Tutoring Systems: A generic course generation authoring tool. Knowledge-Based Systems, 23(8), 864–874. [DOI: https://doi.org/10.1016/j.knosys.2010.05.01.] [GS Search]

Gilbert, S. B., Blessing, S. B., & Guo, E. (2015). Authoring Effective Embedded Tutors: An Overview of the Extensible Problem Specific Tutor (xPST) System. International Journal of Artificial Intelligence in Education, NA. [DOI: https://doi.org/10.1007/s40593-015-0045-0.] [GS Search]

Gómez-Pérez, A. (1996). Towards a framework to verify knowledge sharing technology. Expert Systems with Applications, 11(4), 519–529. [DOI: https://doi.org/10.1016/S0957-4174(96)00067-X.] [GS Search]

González, C., Mora, A., & Toledo, P. (2014). Gamification in intelligent tutoring systems. In Proceedings of the second international conference on technological ecosystems for enhancing multiculturality (pp. 221–225). New York, NY, USA: ACM. [DOI: https://doi.org/10.1145/2669711.2669903.] [GS Search]

Gruber, T. R. (1993, June). A translation approach to portable ontology specifications. Knowl. Acquis., 5(2), 199–220. [GS Search]

Grubisic, A., Stankov, S., & Glavinic, V. (2009). Agent based intelligent courseware generation in e-learning. Proceeding of the IASTED International Conference on Computers and Advanced Technology in Education (CATE). [GS Search]

Guin, N., & Lefevre, M. (2013). From a customizable ITS to an adaptive ITS. International Conference on Artificial Intelligence in Education (AIED), 7926 LNAI, 141–150. [DOI: https://doi.org/10.1007/978-3-642-39112-5_15.] [GS Search]

Hamari, J., Koivisto, J., & Sarsa, H. (2014). Does gamification work?–a literature review of empirical studies on gamification. In System sciences (hicss), 2014 47th hawaii international conference on (pp. 3025–3034). [DOI: https://doi.org/10.1109/HICSS.2014.377.] [GS Search]

Huotari, K., & Hamari, J. (2012). Defining gamification: a service marketing perspective. In Proceeding of the 16th international academic mindtrek conference (pp. 17–22). [DOI: https://doi.org/10.1145/2393132.2393137.] [GS Search]

Lemann, F. (2015). Conselho de classe: A viso dos professores sobre a educação no brasil. Disponível em http://fundacaolemann.org.br/novidades/a-visao-dos-professores-sobre-a-educacaono-brasil. (Acesso em 23 de Julho de 2015).

Ma,W., Adesope, O. O., Nesbit, J. C., & Liu, Q. (2014). Intelligent tutoring systems and learning outcomes: A meta-analysis. Journal of Educational Psychology, 901-918. [DOI: http://dx.doi.org/10.1037/a0037123.] [GS Search]

MacLellan, C. J., Harpstead, E., Wiese, E. S., Zou, M., Matsuda, N., Aleven, V., & Koedinger, K. R. (2015). Authoring tutors with complex solutions: A comparative analysis of example tracing and simstudent. In Proceedings of the workshops at the 17th international conference on artificial intelligence in education, AIED 2015, Madrid, Spain, 2015. [GS Search]

MacLellan, C. J., Koedinger, K. R., & Matsuda, N. (2014). Authoring Tutors with SimStudent: An Evaluation of Efficiency and Model Quality. Intelligent Tutoring Systems, NA. [DOI: https://doi.org/10.1007/978-3-319-07221-0_70.] [GS Search]

Martá-Parreño, J., Seguí-Mas, D., & Seguí-Mas, E. (2016). Teachers’ attitude towards and actual use of gamification. Procedia-Social and Behavioral Sciences, 228, 682–688. [DOI: https://doi.org/10.1016/j.sbspro.2016.07.104.] [GS Search]

Matsuda, N., Cohen, W.W., & Koedinger, K. R. (2015). Teaching the Teacher: Tutoring SimStudent Leads to More Effective Cognitive Tutor Authoring. International Journal of Artificial Intelligence in Education, 25(1). [DOI: https://doi.org/10.1007/s40593-014-0020-1.] [GS Search]

Murray, T. (2003). An overview of intelligent tutoring system authoring tools: Updated analysis of the state of the art. In Authoring tools for advanced technology learning environments (pp. 491–544). Springer. [DOI: https://doi.org/10.1007/978-94-017-0819-7_17.] [GS Search]

Murray, T. (2004). Design tradeoffs in usability and power for advanced educational software authoring tools. EDUCATIONAL TECHNOLOGY-SADDLE BROOK THEN ENGLEWOOD CLIFFS NJ-, 44(5), 10–16. [GS Search]

Nacke, L. E., & Deterding, S. (2017). The maturing of gamification research. Elsevier. [DOI: https://doi.org/10.1016/j.chb.2016.11.062.] [GS Search]

Olsen, J. K., Belenky, D. M., Aleven, V., Rummel, N., Sewall, J., & Ringenberg, M. (2014). Authoring Tools for Collaborative Intelligent Tutoring System Environments. Intelligent Tutoring Systems, NA. [DOI: https://doi.org/10.1007/978-3-319-07221-0_66.] [GS Search]

ProjectTomorrow. (2013). Learning in the 21st century: Digital experiences and expectations of tomorrow’s teachers. Disponível em http://www.tomorrow.org/speakup/tomorrowsteachers report2013.html. (Acesso em 23 de Julho de 2015)

ProjectTomorrow. (2014). Speak up 2014 research project findings - the results of the authentic, unfiltered views of 41,805 k-12 teachers nationwide. Disponível em http://www.tomorrow.org/speakup/pdfs/SU2014 TeacherTop10.pdf. (Acesso em 23 de Julho de 2015)

Refanidis, D. S. (2011). The MATHESIS Semantic Authoring Framework: Ontology-Driven Knowledge Engineering for ITS Authoring. Knowlege-Based and Intelligent Information and Engineering Systems, NA. [DOI: https://doi.org/10.1007/978-3-642-23863-5_12.] [GS Search]

Salen, K., & Zimmerman, E. (2004). Rules of play: Game design fundamentals. MIT press. [GS Search]

Seaborn, K., & Fels, D. I. (2015). Gamification in theory and action: A survey. International Journal of Human-Computer Studies, 74, 14–31. [GS Search]

Shi, L., & Cristea, A. I. (2016). Motivational gamification strategies rooted in self-determination theory for social adaptive e-learning. In A. Micarelli, J. Stamper, & K. Panourgia (Eds.), Intelligent tutoring systems: 13th international conference, its 2016, zagreb, croatia, June 7-10, 2016. proceedings (pp. 294–300). Cham: Springer International Publishing. [DOI: https://doi.org/10.1007/978-3-319-39583-8_32.] [GS Search]

Shute, V. J., & Psotka, J. (1994). Intelligent tutoring systems: Past, present, and future. (Tech. Rep.). DTIC Document. [GS Search]

Silva, A., Costa, E., & Bittencourt, I. I. (2012). Uma linha de produto de software baseada na web semântica para sistemas tutores inteligentes. Revista Brasileira de Informática na Educação, 20(1), 87. [DOI: http://dx.doi.org/10.5753/rbie.2012.20.1.87.] [GS Search]

Sleeman, D., & Brown, J. S. (1982). Intelligent tutoring systems. London: Academic Press. [GS Search]

Sottilare, R., Graesser, A., Hu, X., & Brawner, K. (2015). Design recommendations for intelligent tutoring systems: Authoring tools and expert modeling techniques. Robert Sottilare. [GS Search]

Suraweera, P., Mitrovic, A., & Martin, B. (2010). Widening the knowledge acquisition bottleneck for constraint-based tutors. International Journal of Artificial Intelligence in Education, 20(2), 137–173. [DOI: http://dx.doi.org/10.3233/JAI-2010-0005.] [GS Search]

Troussas, C., Alepis, E., Virvou, M., & Ieee. (2014). Mobile authoring in a multiple language learning environment. Proceedings of the 5th International Conference on Information, Intelligence, Systems and Applications, Iisa 2014, 405–+. [DOI: https://doi.org/10.1109/IISA.2014.6878819.] [GS Search]

Virvou, M., & Troussas, C. (2011). Knowledge-Based Authoring Tool for Tutoring Multiple Languages. Intelligent Interactive Multimedia Systems and Services, NA. [DOI: https://doi.org/10.1007/978-3-642-22158-3_17.] [GS Search]

Werbach, K., & Hunter, D. (2012). For the win: How game thinking can revolutionize your business. Wharton Digital Press. [GS Search]

Wilches, C. O. E., & Palacio, G. V. H. (2014). Development of example-tracing tutors for teaching control systems performance fundamentals. In Proceedings of the 4th world congress on information and communication technologies, wict (pp. 290–295). [GS Search]

Woolf, B. P. (2010). Building intelligent interactive tutors: Student-centered strategies for revolutionizing e-learning. Morgan Kaufmann. [GS Search]




DOI: https://doi.org/10.5753/rbie.2020.28.0.73

____________________________________________________________________________

Revista Brasileira de Informática na Educação (RBIE) (ISSN: 1414-5685; online: 2317-6121)
Brazilian Journal of Computers in Education (RBIE) (ISSN: 1414-5685; online: 2317-6121)