Development of Face Expression Recognition Model to Support Learning Feedback in Higher Education

Face expressions offer a non-verbal channel for understanding student engagement and feedback in higher education learning environment. With the rise of affective computing, face expression recognition (FER) applications have gained attention for their ability to the recognize and respond to learners’ emotional cues in real time. Nevertheless, developing a stable FER model often involves complex deep learning architectures and large-scale annotated datasets. Therefore, this study presents the development of a FER model using Google Teachable Machine (GTM) to support learning feedback in higher education. The proposed FER model can classify five categories of face expressions. A dataset comprising 600 face images was collected and divided into 85% for training and 15% for validation/testing. Model performance was evaluated using accuracy, precision, recall and F1-score metrics. The confusion matrix showed reliable performance for all face expression categories, validating the effectiveness of GTM for accessible FER model.

Face Expression Recognition, Google Teachable

1. R. Pekrun, “The Control-Value Theory of Achievement Emotions: Assumptions, Corollaries, and Implications for Educational Research and Practice,” Educ. Psychol. Rev., vol. 18, no. 4, pp. 315–341, 2006. [Google Scholar] [Crossref]

2. P. Ekman and W. V Friesen, “Constants across cultures in the face and emotion.,” Journal of Personality and Social Psychology, vol. 17, no. 2. American Psychological Association, US, pp. 124–129, 1971. [Google Scholar] [Crossref]

3. Y. Huang, F. Chen, S. Lv, and X. Wang, “Facial Expression Recognition: A Survey,” Symmetry (Basel)., vol. 11, no. 10, 2019. [Google Scholar] [Crossref]

4. A. Mehrabian, “Communication without words,” in Psychology Today, 1968, pp. 51–52. [Google Scholar] [Crossref]

5. R. W. Picard, Affective Computing. MIT Press, 2000. [Google Scholar] [Crossref]

6. R. A. Calvo and S. D’Mello, “Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications,” IEEE Trans. Affect. Comput., vol. 1, no. 1, pp. 18–37, 2010. [Google Scholar] [Crossref]

7. S. D’mello and A. Graesser, “AutoTutor and affective autotutor: Learning by talking with cognitively and emotionally intelligent computers that talk back,” ACM Trans. Interact. Intell. Syst., vol. 2, no. 4, Jan. 2013. [Google Scholar] [Crossref]

8. Y. Gao, L. Zhou, and J. He, “Classroom Expression Recognition Based on Deep Learning,” Appl. Sci., vol. 15, no. 1, 2025. [Google Scholar] [Crossref]

9. “Google Teachable Machine,” 2025. [Online]. Available: https://teachablemachine.withgoogle.com/. [Accessed: 20-May-2025]. [Google Scholar] [Crossref]

10. C. Shan, S. Gong, and P. W. McOwan, “Facial expression recognition based on Local Binary Patterns: A comprehensive study,” Image Vis. Comput., vol. 27, no. 6, pp. 803–816, 2009. [Google Scholar] [Crossref]

11. A. Mollahosseini, D. Chan, and M. H. Mahoor, “Going deeper in facial expression recognition using deep neural networks,” in 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), 2016, pp. 1–10. [Google Scholar] [Crossref]

12. J. Whitehill, Z. Serpell, Y. C. Lin, A. Foster, and J. R. Movellan, “The faces of engagement: Automatic recognition of student engagement from facial expressions,” IEEE Trans. Affect. Comput., vol. 5, no. 1, pp. 86–98, 2014. [Google Scholar] [Crossref]

13. S. Minaee, M. Minaei, and A. Abdolrashidi, “Deep-Emotion: Facial Expression Recognition Using Attentional Convolutional Network,” Sensors, vol. 21, no. 9, 2021. [Google Scholar] [Crossref]

14. D. Abinaya, C. Priyanka, M. Rocky Stefinjain, G. K. D. Prasanna Venkatesan, and S. Kamalraj, “Classification of Facial Expression Recognition using Machine Learning Algorithms,” J. Phys. Conf. Ser., vol. 1937, no. 1, p. 12001, Jun. 2021. [Google Scholar] [Crossref]

15. M. Rahul, N. Tiwari, R. Shukla, D. Tyagi, and V. Yadav, “A New Hybrid Approach for Efficient Emotion Recognition using Deep Learning,” Int. J. Electr. Electron. Res., vol. 10, no. 1, pp. 18–22, 2022. [Google Scholar] [Crossref]

16. Y. Kong, S. Zhang, K. Zhang, Q. Ni, and J. Han, “Real-time facial expression recognition based on iterative transfer learning and efficient attention network,” IET Image Process., vol. 16, no. 6, pp. 1694–1708, 2022. [Google Scholar] [Crossref]

17. A. G. Howard et al., “MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications,” CoRR, vol. abs/1704.0, 2017. [Google Scholar] [Crossref]

18. S. Haslini, A. Hamid, N. Mustapa, and M. F. Mustapha, “An Android Application for Facial Expression Recognition Using Deep Learning,” J. Appl. Math. Comput. Intell., vol. 11, no. 2, pp. 505–520, 2022. [Google Scholar] [Crossref]

19. M. Aly, “Revolutionizing online education: Advanced facial expression recognition for real-time student progress tracking via deep learning model,” Multimed. Tools Appl., vol. 84, no. 13, pp. 12575–12614, 2024. [Google Scholar] [Crossref]

20. Y. Huang, W. Deng, and T. Xu, “A Study of Potential Applications of Student Emotion Recognition in Primary and Secondary Classrooms,” Appl. Sci., vol. 14, no. 23, 2024. [Google Scholar] [Crossref]

21. B. Fang, X. Li, G. Han, and J. He, “Facial Expression Recognition in Educational Research From the Perspective of Machine Learning: A Systematic Review,” IEEE Access, vol. 11, pp. 112060–112074, 2023. [Google Scholar] [Crossref]

22. Z. Shou et al., “A Student Facial Expression Recognition Model Based on Multi-Scale and Deep Fine-Grained Feature Attention Enhancement,” Sensors, vol. 24, no. 20, 2024. [Google Scholar] [Crossref]

23. M. Carney et al., “Teachable Machine: Approachable Web-Based Tool for Exploring Machine Learning Classification,” in Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, 2020, pp. 1–8. [Google Scholar] [Crossref]

24. J. J. N. Wong and N. and Fadzly, “Development of species recognition models using Google teachable machine on shorebirds and waterbirds,” J. Taibah Univ. Sci., vol. 16, no. 1, pp. 1096–1111, Dec. 2022. [Google Scholar] [Crossref]

25. Dev-ShuvoAlok, “RAF-DB DATASET,” 2023. [Online]. Available: https://www.kaggle.com/datasets/shuvoalok/raf-db-dataset?select=DATASET. [Accessed: 01-May-2025]. [Google Scholar] [Crossref]

26. I. Goodfellow, Y. Bengio, and C. Aaron, Deep Learning. MIT Press, 2016. [Google Scholar] [Crossref]

27. M. Tan and Q. Le, “EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks,” in Proceedings of the 36th International Conference on Machine Learning, 2019, vol. 97, pp. 6105–6114. [Google Scholar] [Crossref]

28. L. Bottou, “Stochastic Gradient Descent Tricks,” in Neural Networks: Tricks of the Trade: Second Edition, G. Montavon, G. B. Orr, and K.-R. Müller, Eds. Berlin, Heidelberg: Springer Berlin Heidelberg, 2012, pp. 421–436. [Google Scholar] [Crossref]

29. D. Masters and C. Luschi, “Revisiting Small Batch Training for Deep Neural Networks,” CoRR, vol. abs/1804.0, 2018. [Google Scholar] [Crossref]

30. E. Malahina, R. Hadjon, and F. Bisilisin, “Teachable Machine: Real-Time Attendance of Students Based on Open Source System,” IJICS (International J. Informatics Comput. Sci., vol. 6, no. 3, p. 140−146, 2022. [Google Scholar] [Crossref]

31. K.-A. Tait et al., “Intrusion Detection using Machine Learning Techniques: An Experimental Comparison,” in 2021 International Congress of Advanced Technology and Engineering (ICOTEN), 2021, pp. 1–10. [Google Scholar] [Crossref]

32. A. S. A. Mohammed Aly, “EMU-Net: Automatic Brain Tumor Segmentation and Classification Using Efficient Modified U-Net,” Comput. Mater. \& Contin., vol. 77, no. 1, pp. 557–582, 2023. [Google Scholar] [Crossref]

33. M. H. Behiry and M. Aly, “Cyberattack detection in wireless sensor networks using a hybrid feature reduction technique with AI and machine learning methods,” J. Big Data, vol. 11, no. 1, p. 16, 2024. [Google Scholar] [Crossref]

• Assessment of the Role of Artificial Intelligence in Repositioning TVET for Economic Development in Nigeria
• Teachers’ Use of Assure Model Instructional Design on Learners’ Problem Solving Efficacy in Secondary Schools in Bungoma County, Kenya
• “E-Booksan Ang Kaalaman”: Development, Validation, and Utilization of Electronic Book in Academic Performance of Grade 9 Students in Social Studies
• Analyzing EFL University Students’ Academic Speaking Skills Through Self-Recorded Video Presentation
• Major Findings of The Study on Total Quality Management in Teachers’ Education Institutions (TEIs) In Assam – An Evaluative Study