Strengthening Social-Emotional Skills in Children with Autism using Serious Game

Autism Spectrum Disorder (ASD) is a neurodevelopmental condition characterised by persistent deficits in social interaction, communication difficulties, restricted, repetitive patterns of behaviour and interests as outlined in the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5). These impairments can significantly hinder children's ability to empathise, engage in peer relationships, and manage appropriate social behaviours. In Malaysia, the prevalence of ASD is estimated at approximately 1 in 600 children, reflecting a growing need for effective and inclusive intervention strategies. This study examines the effectiveness of a serious game on the social-emotional skills of children with autism. The study involved eight children aged 5 to 10 years with varying levels of autism severity and was implemented in a classroom setting, supported by three special education teachers. Data collection was conducted through direct classroom observation, interviews with 3 special education teachers, and facial expression recognition to detect emotional responses exhibited by the children with autism during gameplay. The analysis focused on observable changes in emotional expression, engagement levels, and interaction with peers. Findings suggest that the serious game positively influenced the children’s ability to recognise and express emotions, with several instances of improved peer interaction noted during and after gameplay. Teacher feedback further supported these observations, highlighting increased classroom engagement and social participation. The use of facial expression recognition provided objective insights into emotional responses, reinforcing the qualitative findings. Overall, the results demonstrate that game-based intervention, combined with technological tools and educator support, can enhance social-emotional development among children with autism and promote a more inclusive classroom environment.

Autism Spectrum Disorder, Serious Game, Social-Emotional Competence, Game Design

1. American Psychiatric, A. (2013). Diagnostic and Statistical Manual of Mental Disorders (DSM-5). American Psychiatric Association. [Google Scholar] [Crossref]

2. https://doi.org/https://www.psychiatryonline.org/doi/book/10.1176/appi.books.9780890425787 [Google Scholar] [Crossref]

3. Baharom, S. N., Tan, W. H., & Idris, M. Z. (2014). Emotional Design for Games: The Roles of Emotion and Perception in Game Design Process. International Journal of Multimedia and Ubiquitous Engineering, 9(10), 387–398. https://doi.org/10.3850/978-981-09-0463-0_015 [Google Scholar] [Crossref]

4. Baron-Cohen, S., Golan, O., & Ashwin, E. (2009). Can emotion recognition be taught to children with autism spectrum conditions? In Philosophical Transactions of the Royal Society B: Biological Sciences (Vol. 364, pp. 3567–3574). Royal Society. https://doi.org/10.1098/rstb.2009.0191 [Google Scholar] [Crossref]

5. Bernardini, S., Porayska-Pomsta, K., & Smith, T. J. (2014). ECHOES: An intelligent serious game for fostering social communication in children with autism. Information Sciences, 264, 41–60. https://doi.org/10.1016/j.ins.2013.10.027 [Google Scholar] [Crossref]

6. Carreno-Leon, M. A., Sandoval-Bringas, J. A., Encinas, I. D., Castro, R. C., Cota, I. E., & Carrillo, A. L. (2021). Managing emotions in autistic children through serious game with tangible interfaces. Proceedings - 2021 4th International Conference on Inclusive Technology and Education, CONTIE 2021, 126–133. https://doi.org/10.1109/CONTIE54684.2021.00029 [Google Scholar] [Crossref]

7. Chaidi, I., & Drigas, A. (2020). Autism, expression, and understanding of emotions: Literature review. International Journal of Online and Biomedical Engineering, 16(2), 94–111.https://doi.org/10.3991/ijoe.v16i02.11991 [Google Scholar] [Crossref]

8. Conner, C. M., White, S. W., Lawrence, S., & Mazefsky, C. A. (2020). The Role of Emotion Regulation and Core Autism Symptoms in the Experience of Anxiety in Autism HHS Public Access. Autism, 24(4), 931–940. https://doi.org/10.1177/1362361320904217 [Google Scholar] [Crossref]

9. Dantas, A. C., & Nascimento, M. Z. Do. (2022). Recognition of Emotions for People with Autism: An Approach to Improve Skills. International Journal of Computer Games Technology, 2022. https://doi.org/10.1155/2022/6738068 [Google Scholar] [Crossref]

10. Dapogny, A., Grossard, C., Hun, S., Serret, S., Bourgeois, J., Jean-Marie, H., Foulon, P., Ding, H., Chen, L., Dubuisson, S., Grynszpan, O., Cohen, D., & Bailly, K. (2018). JEMImE: A serious game to teach children with ASD how to adequately produce facial expressions. Proceedings - 13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018, 723–730. https://doi.org/10.1109/FG.2018.00114 [Google Scholar] [Crossref]

11. Daud, N. F. N. M., Abdullah, M. H. L., & Zakaria, M. H. (2023). Serious Game Design Principles for Children with Autism to Facilitate the Development of Emotion Regulation. International Journal of Advanced Computer Science and Applications (IJACSA), 14(5). [Google Scholar] [Crossref]

12. https://doi.org/DOI:10.14569/IJACSA.2023.01405100 [Google Scholar] [Crossref]

13. Day, T. N., Mazefsky, C. A., & Wetherby, A. M. (2022). Characterizing difficulties with emotion regulation in toddlers with autism spectrum disorder. Research in Autism Spectrum Disorders, 96. https://doi.org/10.1016/j.rasd.2022.101992 [Google Scholar] [Crossref]

14. de Mooij, B., Fekkes, M., Scholte, R. H. J., & Overbeek, G. (2020). Effective Components of Social Skills Training Programs for Children and Adolescents in Nonclinical Samples: A Multilevel Metaanalysis. Clinical Child and Family Psychology Review, 23(2), 250–264. [Google Scholar] [Crossref]

15. https://doi.org/10.1007/S10567-019-00308-X [Google Scholar] [Crossref]

16. Dizicheh, E. G., Moradi, H., Nezam Abadi, M. B., Shahrokh, F., Samani, R., & Kashani-Vahid, L. (2021). EmoAnim: A Serious Game for Screening Children with Autism using Emotions in Animations. Proceedings of the 3rd International Serious Games Symposium, ISGS 2021, 75–80. [Google Scholar] [Crossref]

17. https://doi.org/10.1109/ISGS54702.2021.9684762 [Google Scholar] [Crossref]

18. Eow, S. Y., Gan, W. Y., Lim, P. Y., Awang, H., & Mohd Shariff, Z. (2020). Factors associated with autism severity among Malaysian children with Autism Spectrum Disorder. Research in Developmental Disabilities, 100. https://doi.org/10.1016/j.ridd.2020.103632 [Google Scholar] [Crossref]

19. Fuentes, J., Bakare, M., Munir, K., Aguayo, P., Gaddour, N., & Oner, O. (2012). Autism Spectrum Disorder. In ACAPAP e-textbook of child and adolescent mental health. Geneva: International Association for Child and Adolescent Psychiatry and Allied Professions (pp. 1–27). [Google Scholar] [Crossref]

20. Goldsmith, S. F., & Kelley, E. (2018). Associations Between Emotion Regulation and Social Impairment in Children and Adolescents with Autism Spectrum Disorder. Journal of Autism and Developmental Disorders, 48(6), 2164–2173. https://doi.org/10.1007/s10803-018-3483-3 [Google Scholar] [Crossref]

21. Gómez-León, M. I. (2025). Serious games to support emotional regulation strategies in educational intervention programs. Systematic review and meta-analysis. Heliyon, 11(4), e42712. https://doi.org/10.1016/J.HELIYON.2025.E42712 [Google Scholar] [Crossref]

22. Hassan, A., Pinkwart, N., & Shafi, M. (2021). Serious games to improve social and emotional intelligence in children with autism. In Entertainment Computing (Vol. 38). Elsevier B.V. https://doi.org/10.1016/j.entcom.2021.100417 [Google Scholar] [Crossref]

23. Hodges, H., Fealko, C., & Soares, N. (2020). Autism spectrum disorder: Definition, epidemiology, causes, and clinical evaluation. In Translational Pediatrics (Vol. 9, pp. S55–S65). AME Publishing Company. https://doi.org/10.21037/tp.2019.09.09 [Google Scholar] [Crossref]

24. Kellidou, P. M., Kotzageorgiou, M., Voulgari, I., & Nteropoulou Nterou, E. (2020). A Review of Digital Games for Children with Autism Spectrum Disorder. ACM International Conference Proceeding Series, 227–234. https://doi.org/10.1145/3439231.3439270 [Google Scholar] [Crossref]

25. Khan, M. S., Mohamadali, N. A. K., Maher, Z. A., Nisa, S. Q., Shaikh, H., & Shah, A. (2019). Information technology (IT) based intervention among individuals with ASD (autism spectrum disorder): A review. 2nd IEEE International Conference on Innovative Research and Development, ICIRD 2019. https://doi.org/10.1109/ICIRD47319.2019.9074749 [Google Scholar] [Crossref]

26. Khor, C. Y., Mubin, S. A., Tan, C. I., Thiruchelvam, V., Neo, T. K., & Teoh, G. K. (2025). A Multimodal Framework for Integrating Motion Capture Monitoring into ASD Screening Utilizing XR Applications. Proceedings of the ACM on Human-Computer Interaction, 9(4). [Google Scholar] [Crossref]

27. https://doi.org/10.1145/3734435/ASSET/2ED950D3-F3FA-4662-B43E-708EDA1DFA38/ASSETS/GRAPHIC/PACMHCIV9I4-3325-IMG3.JPG [Google Scholar] [Crossref]

28. Kokkalia, G., Drigas, A., & Economou, A. (2017). The Use of Serious Games in Preschool Education. International Journal of Emerging Technologies in Learning (IJET), 12(11), 15–27. [Google Scholar] [Crossref]

29. https://doi.org/10.3991/ijet.v12.i11.6991 [Google Scholar] [Crossref]

30. Kokol, P., Vošner, H. B., Završnik, J., Vermeulen, J., Shohieb, S., & Peinemann, F. (2020). Serious Game-based Intervention for Children with Developmental Disabilities. Current Pediatric Reviews, 16(1), 26–32. https://doi.org/10.2174/1573396315666190808115238 [Google Scholar] [Crossref]

31. Lee, C. S. C., Lam, S. H. F., Tsang, S. T. K., Yuen, C. M. C., & Ng, C. K. M. (2018). The Effectiveness of Technology-Based Intervention in Improving Emotion Recognition Through Facial Expression in People with Autism Spectrum Disorder: A Systematic Review. In Review Journal of Autism and Developmental Disorders (Vol. 5, pp. 91–104). Springer New York LLC. [Google Scholar] [Crossref]

32. https://doi.org/10.1007/s40489-017-0125-1 [Google Scholar] [Crossref]

33. Martínez-González, A. E., Cervin, M., & Piqueras, J. A. (2022). Relationships Between Emotion Regulation, Social Communication and Repetitive Behaviors in Autism Spectrum Disorder. Journal of Autism and Developmental Disorders, 52(10), 4519–4527. https://doi.org/10.1007/s10803-02105340-x [Google Scholar] [Crossref]

34. Mohan, V., Kunnath, S. K., Philip, V. S., Mohan, L. S., & Thampi, N. (2019). Capitalizing on technology for developing communication skills in autism spectrum disorder: a single case study. [Google Scholar] [Crossref]

35. Disability and Rehabilitation: Assistive Technology, 14(1), 75–81. [Google Scholar] [Crossref]

36. https://doi.org/10.1080/17483107.2017.1413144 [Google Scholar] [Crossref]

37. Mohd Roslan, M. A., & Mohidem, N. A. (2025). Parental attitudes on Autism Spectrum Disorder development among children in Malaysia: A review. Integrated Research Advances, 2(12), 1412– 1412. https://pubmed.ncbi.nlm.nih.gov/ [Google Scholar] [Crossref]

38. Papoutsi, C., Drigas, A., & Skianis, C. (2018). Mobile applications to improve emotional intelligence in Autism - A review. In International Journal of Interactive Mobile Technologies (Vol. 12, pp. 47–61). International Association of Online Engineering. https://doi.org/10.3991/ijim.v12i6.9073 [Google Scholar] [Crossref]

39. Pedreschi, V. B., Díaz, D. A. O., Aguirre, J. A., & Gonzalez, P. A. (2019). A technological platform using serious game for children with Autism Spectrum Disorder (ASD) in Peru. Proceedings of the LACCEI International Multi-Conference for Engineering, Education and Technology, 2019-July. https://doi.org/10.18687/LACCEI2019.1.1.278 [Google Scholar] [Crossref]

40. Reyes, N. M., Factor, R., & Scarpa, A. (2020). Emotion regulation, emotionality, and expression of emotions: A link between social skills, behavior, and emotion problems in children with ASD and their peers. Research in Developmental Disabilities, 106. https://doi.org/10.1016/j.ridd.2020.103770 [Google Scholar] [Crossref]

41. Sharma, K., Papavlasopoulou, S., & Giannakos, M. (2019). Joint emotional state of children and perceived collaborative experience in coding activities. Proceedings of the 18th ACM International Conference on Interaction Design and Children, IDC 2019, 133–145. [Google Scholar] [Crossref]

42. https://doi.org/10.1145/3311927.3323145 [Google Scholar] [Crossref]

43. Stathopoulou, A., Loukeris, D., Karabatzaki, Z., Politi, E., Salapata, Y., & Drigas, A. (2020). Evaluation of Mobile Apps Effectiveness in Children with Autism Social Training via Digital Social Stories. International Journal of Interactive Mobile Technologies (IJIM), 14(03), 4. https://doi.org/10.3991/ijim.v14i03.10281 [Google Scholar] [Crossref]

44. Syeda, U. H., Zafar, Z., Islam, Z. Z., Tazwar, S. M., Rasna, M. J., Kise, K., & Ahad, M. A. R. (2017). Visual face scanning and emotion perception analysis between autistic and typically developing children. UbiComp/ISWC 2017 - Adjunct Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers, 844–853. https://doi.org/10.1145/3123024.3125618 [Google Scholar] [Crossref]

45. Tsikinas, S., & Xinogalos, S. (2019). Design guidelines for serious games targeted to people with autism. Smart Innovation, Systems and Technologies, 144, 489–499. https://doi.org/10.1007/978981-13-8260-4_43 [Google Scholar] [Crossref]

46. Villani, D., Carissoli, C., Triberti, S., Marchetti, A., Gilli, G., & Riva, G. (2018). Videogames for Emotion Regulation: A Systematic Review. Games for Health Journal, 7, 85–99. https://doi.org/10.1089/g4h.2017.0108 [Google Scholar] [Crossref]

47. Volkmar, F. R. (2021). Encyclopedia of Autism Spectrum Disorders (Second Edition). Springer International Publishing. https://doi.org/https://doi.org/10.1007/978-3-319-91280-6 [Google Scholar] [Crossref]

48. Wagener, G. L., Berning, M., Costa, A. P., Steffgen, G., & Melzer, A. (2021). Effects of Emotional Music on Facial Emotion Recognition in Children with Autism Spectrum Disorder (ASD). Journal of Autism and Developmental Disorders, 51(9), 3256–3265. https://doi.org/10.1007/s10803-02004781-0 [Google Scholar] [Crossref]

49. Whitley, C. (2016). Socio-Emotional Development in Children with Autism Spectrum Disorder. In Department of History: Vol. Bachelor of Arts. [Google Scholar] [Crossref]

50. Wu, C., & Zheng, Q. (2019). Motion Sensing Games for Children with Autism Spectrum Disorder. VR, Simulations and Serious Games for Education, 55–65. https://doi.org/10.1007/978-981-132844-2_6 [Google Scholar] [Crossref]

51. Yaacob, W. N. W., Yaacob, L. H., Zulkifli, M. M., & Muhamad, R. (2022). A Journey towards Resilience: Coping Strategies Adopted by Parents with Children Having Autism Spectrum Disorder in Northeast Malaysia. International Journal of Environmental Research and Public Health, 19(4). https://doi.org/10.3390/ijerph19042458 [Google Scholar] [Crossref]

• Assessment of the Role of Artificial Intelligence in Repositioning TVET for Economic Development in Nigeria
• Teachers’ Use of Assure Model Instructional Design on Learners’ Problem Solving Efficacy in Secondary Schools in Bungoma County, Kenya
• “E-Booksan Ang Kaalaman”: Development, Validation, and Utilization of Electronic Book in Academic Performance of Grade 9 Students in Social Studies
• Analyzing EFL University Students’ Academic Speaking Skills Through Self-Recorded Video Presentation
• Major Findings of The Study on Total Quality Management in Teachers’ Education Institutions (TEIs) In Assam – An Evaluative Study