Design and Evaluation of an AI Chatbot for Student Academic Advising

This research aims to design and evaluate an AI chatbot for student academic advising at Arellano University – Jose Abad Santos based on user feedback, usability testing, and expert analysis. The study proposes practical recommendations and knowledge base improvements to support ongoing efforts in digital student services, student engagement, and satisfaction.

AI chatbot, academic advising, student support, usability, artificial intelligence

1. L. Labadze, M. Grigolia and L. Machaidze, "Role of AI Chatbots in Education: Systematic Literature Review," International Journal of Educational Technology in Higher Education, vol. 20, no. 1, p. 56, 2023. [Google Scholar] [Crossref]

2. M. A. Kuhail, N. Alturki, S. Alramlawi and K. Alhejori, "Interacting with Educational Chatbots: A Systematic Review," Education and Information Technologies, vol. 28, no. 1, p. 973–1018, January 2023. [Google Scholar] [Crossref]

3. C. W. Okonkwo and A. Ade-Ibijola, "Chatbots Applications in Education: A Systematic Review," Computers and Education: Artificial Intelligence, vol. 2, p. 100033, 2021. [Google Scholar] [Crossref]

4. J. Belda-Medina and V. Kokošková, "Integrating Chatbots in Education: Insights from the Chatbot-Human Interaction Satisfaction Model (CHISM)," International Journal of Educational Technology in Higher Education, vol. 20, no. 1, p. 62, 19 December 2023. [Google Scholar] [Crossref]

5. J. H. Al Shamsi, M. Al-Emran and K. Shaalan, "Understanding Key Drivers Affecting Students' Use of Artificial Intelligence-Based Voice Assistants," Education and Information Technologies, vol. 27, no. 6, p. 8071–8091, 2022. [Google Scholar] [Crossref]

6. S. Antony and R. Ramnath, "A Phenomenological Exploration of Students' Perceptions of AI Chatbots in Higher Education," IAFOR Journal of Education, vol. 11, no. 2, p. 7–38, 26 August 2023. [Google Scholar] [Crossref]

7. G. Bilquise and K. Shaalan, "AI-based Academic Advising Framework: A Knowledge Management Perspective," International Journal of Advanced Computer Science and Applications, vol. 13, no. 8, 2022. [Google Scholar] [Crossref]

8. G. S. Masula, R. C. Barrios and E. B. Hilario, "Chatbot as Academic Companion: Exploring Education Students’ Narratives in Using Artificial Intelligence in Learning," Journal of Interdisciplinary Perspectives, vol. 3, no. 6, p. 224–234, June 2025. [Google Scholar] [Crossref]

9. G. Bilquise, S. Ibrahim and K. Shaalan, "Bilingual AI-Driven Chatbot for Academic Advising," International Journal of Advanced Computer Science and Applications, vol. 13, no. 8, pp. 50-57, 2022. [Google Scholar] [Crossref]

10. R. Lucien and S. Park, "Design and Development of an Advising Chatbot as a Student Support Intervention in a University System," TechTrends, vol. 68, no. 1, p. 79–90, January 2024. [Google Scholar] [Crossref]

11. R. Mitra, D. Schwieger and R. Lowe, "Managing Graduate Student Advisement Questions during a Season of Explosive Growth: Development and Testing of an Advising Chatbot," Information Systems Education Journal, vol. 21, no. 3, p. 12–23, July 2023. [Google Scholar] [Crossref]

12. H. Nguyen, J. Lopez, B. D. Homer, A. Ali, S. Finkelstein and e. al., "Reminders, Reflections, and Relationships: Insights from the Design of a Chatbot for College Advising," Information and Learning Sciences, vol. 124, no. 3/4, p. 229–246, April 2023. [Google Scholar] [Crossref]

13. D. Akiba and M. C. Fraboni, "AI-Supported Academic Advising: Exploring ChatGPT's Current State and Future Potential toward Student Empowerment," Education Sciences, vol. 13, no. 9, p. 885, 2023. [Google Scholar] [Crossref]

14. O. Iatrellis, N. Samaras, K. Kokkinos and T. Panagiotakopoulos, "Leveraging Generative AI for Sustainable Academic Advising: Enhancing Educational Practices through AI-Driven Recommendations," Sustainability, vol. 16, no. 17, p. 7829, September 2024. [Google Scholar] [Crossref]

15. M. F. Alsoyohi and N. Algethami, "Chatbot for Academic Advising: Case Study at Saudi Electronic University," Journal of Computer Science, vol. 22, no. 3, p. 840–859, March 2026. [Google Scholar] [Crossref]

16. J. Odede and I. Frommholz, "JayBot – Aiding University Students and Admission with an LLM-based Chatbot," in Proceedings of the 2024 ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR '24'), Sheffield, United Kingdom, 2024. [Google Scholar] [Crossref]

17. E. L. DeRosa, "Academic Advising's Hidden Role in Fostering Validation/Belonging Leading to Improved Grades," NACADA Journal, vol. 43, no. 2, p. 121–135, December 2023. [Google Scholar] [Crossref]

18. N. Abbas, J. Whitfield, E. Atwell, H. Bowman, T. Pickard and A. Walker, "Online Chat and Chatbots to Enhance Mature Student Engagement in Higher Education," International Journal of Lifelong Education, vol. 41, no. 3, p. 308–326, May 2022. [Google Scholar] [Crossref]

19. A. M. Al-Abdullatif, A. A. Al-Dokhny and A. M. Drwish, "Implementing the Bashayer Chatbot in Saudi Higher Education: Measuring the Influence on Students' Motivation and Learning Strategies," Frontiers in Psychology, vol. 14, p. 1129070, 2023. [Google Scholar] [Crossref]

20. K. Peyton, S. Unnikrishnan and B. Mulligan, "A Review of University Chatbots for Student Support: FAQs and Beyond," Discover Education, vol. 4, no. 1, p. 21, January 2025. [Google Scholar] [Crossref]

21. B. A. Chagas, A. S. Pagano, R. O. Prates, E. C. Praes, K. Ferreguetti, H. Vaz, Z. S. Nogueira Reis, L. B. Ribeiro, A. L. P. Ribeiro, T. M. Pedroso, A. Beleigoli, C. R. A. Oliveira and M. S. Marcolino, "Evaluating User Experience With a Chatbot Designed as a Public Health Response to the COVID-19 Pandemic in Brazil: Mixed Methods Study," JMIR Human Factors, vol. 10, p. e43135, April 2023. [Google Scholar] [Crossref]

22. M. M. Thottoli, B. H. Alruqaishi and A. Soosaimanickam, "Robo Academic Advisor: Can Chatbots and Artificial Intelligence Replace Human Interaction?," Contemporary Educational Technology, vol. 16, no. 1, January 2024. [Google Scholar] [Crossref]

23. D. Ramandanis and S. Xinogalos, "Investigating the Support Provided by Chatbots to Educational Institutions and Their Students: A Systematic Literature Review," Multimodal Technologies and Interaction, vol. 7, no. 11, p. 103, November 2023. [Google Scholar] [Crossref]

24. M. A. Kuhail, H. A. Khateeri, J. Negreiros, A. Seffah and O. Alfandi, "Engaging Students With a Chatbot-Based Academic Advising System," International Journal of Human-Computer Interaction, vol. 39, no. 10, p. 1–27, 2022. [Google Scholar] [Crossref]

25. G. Bilquise, S. Ibrahim and K. Shaalan, "Emotionally Intelligent Chatbots: A Systematic Literature Review," Human Behavior and Emerging Technologies, vol. 2022, p. 9601630, September 2022. [Google Scholar] [Crossref]

• Enhancing Social Experience in Home Network Assisted Tools
• Development of a Smart Chair for Real-Time Posture Detection to Promote Ergonomic Habits in Sedentary Workspaces
• Evaluating the User Experience of AI-Assisted Programming Tools among Computer Studies College Students