Relationship Between Artificial Intelligence (AI) Application Skills and Mathematical Understanding among Malaysian Secondary School Students

The rapid advancement of Artificial Intelligence (AI) has reshaped mathematics education by creating new opportunities for personalised, interactive, and self-directed learning. However, the growing accessibility of AI-powered applications has also raised concerns that students may become increasingly dependent on AI-generated solutions without developing a deep understanding of mathematical concepts or engaging in independent problem-solving. This emerging challenge highlights the need to understand not only students’ use of AI, but also their competencies in applying AI effectively to support meaningful learning. Therefore, this study examined secondary school students’ levels of mathematical understanding, AI application skills, and frequency of AI use in mathematics learning, as well as the relationship between AI application skills and mathematical understanding. A quantitative cross-sectional survey design was employed involving 59 Form Four and Form Five students from selected secondary schools in Selangor, Malaysia, recruited through purposive and convenience sampling. Data were collected using a structured online questionnaire and analysed using descriptive statistics and Pearson correlation analysis. The findings revealed positive AI application skills (M = 3.65), positive mathematical understanding (M = 3.55), and frequent AI application use (M = 3.56), while students also reported positive perceptions towards AI-supported mathematics learning (M = 3.46, SD = 0.553). Pearson correlation analysis further demonstrated a statistically significant moderate positive relationship between AI application skills and mathematical understanding (r = .510, p < .001), indicating that students who were more competent in using AI applications tended to report better mathematical understanding. Unlike previous studies that have primarily focused on AI adoption or students’ acceptance of AI technologies, this study demonstrates that students’ competencies in using AI constitute an important educational factor associated with mathematical understanding. The findings suggest that the educational value of AI lies not merely in the availability of intelligent technologies but in students’ ability to use them critically, ethically, and purposefully. These findings provide practical evidence for educators and policymakers in Malaysia to strengthen AI literacy within mathematics education, particularly in developing students’ prompt construction skills, critical evaluation of AI-generated information, and responsible AI practices to support future-ready learning.

Artificial Intelligence (AI), AI literacy, Mathematics Education, Mathematical Understanding, AI-assisted Mathematics Learning, Secondary School Students.

1. Ahmed, R. (2026). The mediating role of students' digital literacy in the relationship between artificial intelligence based learning tools and academic performance. Journal of Research, Innovation, and Strategies for Education, 3(2), 46-69. https://doi.org/10.70148/rise.v3i2.4 [Google Scholar] [Crossref]

2. Ali, F., Choy, D., Divaharan, S., Tay, H. Y., & Chen, W. (2023). Supporting self-directed learning and self-assessment using TeacherGAIA, a generative AI chatbot application: Learning approaches and prompt engineering. Learning: Research and Practice. https://doi.org/10.1080/23735082.2023.2258886 [Google Scholar] [Crossref]

3. Arifin, A., Pujiastuti, H., Nindiasari, H., & Ediwarman. (2025). Developing an AI-based LMS to support self-regulated learning in secondary mathematics education. Al-Ishlah: Jurnal Pendidikan, 17(4), 7580-7594. https://doi.org/10.35445/alishlah.v17i4.7686 [Google Scholar] [Crossref]

4. Arifin, M., Zulkarnain, I., & Ansori, H. (2025). The influence of artificial intelligence on critical thinking ability in mathematics: A systematic literature review. Indonesian Journal of Science and Mathematics Education. https://doi.org/10.24042/ijsme.v8i1.24352 [Google Scholar] [Crossref]

5. Bastani, H., Bastani, O., Sungu, A., Ge, H., Kabakcı, Ö., & Mariman, R. (2025). Generative AI without guardrails can harm learning: Evidence from high school mathematics. Proceedings of the National Academy of Sciences of the United States of America, 122. https://doi.org/10.1073/pnas.2422633122 [Google Scholar] [Crossref]

6. Bueie, A. A., Skar, G. B., & Graham, S. (2026). High school students’ use and beliefs about generative artificial intelligence and writing in school. Reading and Writing, 39, 597–627. https://doi.org/10.1007/s11145-025-10702-3 [Google Scholar] [Crossref]

7. Canonigo, A. (2024). Levering AI to enhance students' conceptual understanding and confidence in mathematics. J. Comput. Assist. Learn., 40, 3215-3229. https://doi.org/10.1111/jcal.13065 [Google Scholar] [Crossref]

8. Çela, E., Fonkam, M., & Potluri, R. M. (2024). Risks of AI-assisted learning on student critical thinking: A case study of Albania. International Journal of Risk and Contingency Management, 12(1). https://doi.org/10.4018/IJRCM.350185 [Google Scholar] [Crossref]

9. Chee, H., Ahn, S., & Lee, J. (2025). A competency framework for AI literacy: Variations by different learner groups and an implied learning pathway. British Journal of Educational Technology, 56, 2146–2182. https://doi.org/10.1111/bjet.13556 [Google Scholar] [Crossref]

10. Chen, R., Lee, V. R., Kuo, A. C., Pope, D. C., & Miles, S. (2026). Cheating in the second year of generative AI chatbots: A follow-up study on high school student cheating behaviors. Educational Technology Research and Development, 74, 639–667. https://doi.org/10.1007/s11423-026-10587-1 [Google Scholar] [Crossref]

11. Chiu, T. K. F. (2024). A classification tool to foster self-regulated learning with generative artificial intelligence by applying self-determination theory: A case of ChatGPT. Educational Technology Research and Development, 72, 2401–2416. https://doi.org/10.1007/s11423-024-10366-w [Google Scholar] [Crossref]

12. Chudziak, J. A., & Kostka, A. (2025). AI-Powered Math Tutoring: Platform for Personalized and Adaptive Education. 462-469. https://doi.org/10.1007/978-3-031-98465-5_58 [Google Scholar] [Crossref]

13. Chung, J., Henderson, M., Slade, C., Liang, Y., Pepperell, N., Corbin, T., Walton, J., Yu, A. S., Bearman, M., Buckingham Shum, S., Fawns, T., McCluskey, T., McLean, J., Oberg, G., Seligmann, A., Shibani, A., Bakharia, A., Lim, L.-A., & Matthews, K. E. (2026). The use and usefulness of GenAI in higher education: Student experience and perspectives. Computers and Education Open, 10, Article 100347. https://doi.org/10.1016/j.caeo.2026.100347 [Google Scholar] [Crossref]

14. Creswell, J. W. (2009). Research design: Qualitative, quantitative, and mixed methods approaches (3rd ed.). SAGE Publications. [Google Scholar] [Crossref]

15. Del Rosario Navas Bonilla, C., Carrasco, L. M. V., Pupiales, J. C. G., & Noriega, D. E. M. (2025). The Future of Education: A Systematic Literature Review of Self-Directed Learning with AI. Future Internet, 17, 366. https://doi.org/10.3390/fi17080366 [Google Scholar] [Crossref]

16. Diaz, D. D., Funa, A. A., & Gabay, R. A. E. (2025). ChatGPT in STEM classrooms: Students’ perceptions of interest, academic proficiency, and learning independence. Journal of Basic Education Research, 6(3), 470–480. https://doi.org/10.37251/jber.v6i3.2096 [Google Scholar] [Crossref]

17. Egara, F. O., Mosimege, M., & Mosia, M. (2025). Secondary school students’ perceptions of their usage of artificial intelligence-based ChatGPT in mathematics learning. Journal of Education, (98), 125-146. http://dx.doi.org/10.17159/2520-9868/i98a07 [Google Scholar] [Crossref]

18. Esiyok, E., Gokcearslan, S., & Kucukergin, K. G. (2025). Acceptance of educational use of AI chatbots in the context of self-directed learning with technology and ICT self-efficacy of undergraduate students. International Journal of Human–Computer Interaction, 41(1), 641-650. https://doi.org/10.1080/10447318.2024.2303557 [Google Scholar] [Crossref]

19. Gill, S. S., Xu, M., Patros, P., Wu, H., Kaur, R., Kaur, K., Fuller, S., Singh, M., Arora, P., Parlikad, A. K., Stankovski, V., Abraham, A., Ghosh, S. K., Lutfiyya, H., Kanhere, S. S., Bahsoon, R., Rana, O., Dustdar, S., Sakellariou, R., ... Buyya, R. (2023). Transformative effects of ChatGPT on modern education: Emerging era of AI chatbots. https://10.48550/arXiv.2306.03823 [Google Scholar] [Crossref]

20. Grace Lau, C. T., Tang, H. E., & Chien, T. M. (2025). Exploring foundation students' AI math tool preferences, duration of use, and confidence in mathematics problem-solving. Journal of Mathematics and Science Teacher, 5(4), Article em089. https://doi.org/10.29333/mathsciteacher/16869 [Google Scholar] [Crossref]

21. Haguchi, M., Wachidah, N. C., Adi, G. S., Irawijayanti, F., & Fatqurhohman, F. (2026). The effect of artificial intelligence–based learning on students' mathematical thinking in secondary education. Journal of Innovation in Education and Learning, 2(1), 13-26. https://doi.org/10.66031/jinea.v2i1.160 [Google Scholar] [Crossref]

22. Hair, J. F., Risher, J. J., Sarstedt, M., & Ringle, C. M. (2019). When to use and how to report the results of PLS-SEM. European business review, 31(1), 2–24. https://doi.org/10.1108/ebr-11-2018-0203 [Google Scholar] [Crossref]

23. Infante, R. N., Corocoto, M. A., & Nobis, M. L., Jr. (2025). Students’ perspectives, practices, and challenges in AI-driven mathematics education. Psychology and Education: A Multidisciplinary Journal, 41(6), 687-701. https://doi.org/10.70838/pemj.410602 [Google Scholar] [Crossref]

24. Jančařík, A., Michal, J., & Novotná, J. (2023). Using AI chatbot for math tutoring. Journal of Education Culture and Society, (2), 285-296. https://doi.org/10.15503/jecs2023.2.285.296 [Google Scholar] [Crossref]

25. Javier, D. R. C., & Moorhouse, B. L. (2024). Developing secondary school English language learners' productive and critical use of ChatGPT. TESOL Journal, 15, Article e755. https://doi.org/10.1002/tesj.755 [Google Scholar] [Crossref]

26. Kim, J., Yu, S., Lee, S.-S., & Detrick, R. (2025). Students’ prompt patterns and its effects in AI-assisted academic writing: Focusing on students’ level of AI literacy. Journal of Research on Technology in Education. https://doi.org/10.1080/15391523.2025.2456043 [Google Scholar] [Crossref]

27. Klarin, J., Hoff, E., Larsson, A., & Daukantaitė, D. (2024). Adolescents’ use and perceived usefulness of generative AI for schoolwork: Exploring their relationships with executive functioning and academic achievement. Frontiers in Artificial Intelligence, 7, Article 1415782. https://doi.org/10.3389/frai.2024.1415782 [Google Scholar] [Crossref]

28. Knoth, N., Tolzin, A., Janson, A., & Leimeister, J. M. (2024). AI literacy and its implications for prompt engineering strategies. Computers and Education: Artificial Intelligence, 6, 100225. https://doi.org/10.1016/j.caeai.2024.100225 [Google Scholar] [Crossref]

29. Kothari, C. R. (2004). Research methodology: Methods and techniques (2nd rev. ed.). New Age International Publishers. [Google Scholar] [Crossref]

30. Lan, M., & Zhou, X. (2025). A qualitative systematic review on AI empowered self-regulated learning in higher education. NPJ Science of Learning, 10. https://doi.org/10.1038/s41539-025-00319-0 [Google Scholar] [Crossref]

31. Li, K. (2023). Determinants of college students’ actual use of AI-based systems: An extension of the technology acceptance model. Sustainability, 15(6), 5221. https://doi.org/10.3390/su15065221 [Google Scholar] [Crossref]

32. Liu, B., Zhang, W., & Wang, F. (2026). Can Generative Artificial Intelligence Effectively Enhance Students’ Mathematics Learning Outcomes?—A Meta-Analysis of Empirical Studies from 2023 to 2025. Education Sciences. https://doi.org/10.3390/educsci16010140 [Google Scholar] [Crossref]

33. Marwiang, M., Prasertsang, M., & Junpeng, P. (2025). Enhancing students’ learning outcomes in mathematics through intelligent tutoring systems based on real-time feedback. Journal of Education and Learning, 14(6), 186. https://doi.org/10.5539/jel.v14n6p186 [Google Scholar] [Crossref]

34. Ng, D. T. K., Su, J., Leung, J. K. L., & Chu, S. K. W. (2023). Artificial intelligence (AI) literacy education in secondary schools: A review. Interactive Learning Environments. https://doi.org/10.1080/10494820.2023.2255228 [Google Scholar] [Crossref]

35. Pardos, Z., & Bhandari, S. (2024). ChatGPT-generated help produces learning gains equivalent to human tutor-authored help on mathematics skills. PLOS ONE, 19, e0304013. https://doi.org/10.1371/journal.pone.0304013 [Google Scholar] [Crossref]

36. Polydoros, G., Galitskaya, V., Pergantis, P., Drigas, A., Antoniou, A.-S., & Beazidou, E. (2025). Innovative AI-driven approaches to mitigate math anxiety and enhance resilience among students with persistently low performance in mathematics. Psychology International, 7(2), Article 46. https://doi.org/10.3390/psycholint7020046 [Google Scholar] [Crossref]

37. Rane, N. L. (2023). Enhancing mathematical capabilities through ChatGPT and similar generative artificial intelligence: Roles and challenges in solving mathematical problems. SSRN. http://dx.doi.org/10.2139/ssrn.4603237 [Google Scholar] [Crossref]

38. Salhab, R., & Aboushi, M. M. (2025). Influence of AI literacy and 21st-century skills on the acceptance of generative artificial intelligence among college students. Frontiers in Education, 10, 1640212. https://doi.org/10.3389/feduc.2025.1640212 [Google Scholar] [Crossref]

39. Shih, S.-C., Chang, C.-C., Kuo, B.-C., & Huang, Y.-H. (2023). Mathematics intelligent tutoring system for learning multiplication and division of fractions based on diagnostic teaching. Education and Information Technologies, 28, 9189–9210. https://doi.org/10.1007/s10639-022-11553-z [Google Scholar] [Crossref]

40. Son, T. (2024). Intelligent Tutoring Systems in Mathematics Education: A Systematic Literature Review Using the Substitution, Augmentation, Modification, Redefinition Model. Comput., 13, 270. https://doi.org/10.3390/computers13100270 [Google Scholar] [Crossref]

41. Torres-Peña, R. C., Peña-González, D., Chacuto-López, E., Ariza, E. A., & Vergara, D. (2024). Updating calculus teaching with AI: A classroom experience. Education Sciences, 14(9), 1019. https://doi.org/10.3390/educsci14091019 [Google Scholar] [Crossref]

42. Turós, M., Nagy, R., & Szűts, Z. (2025). What percentage of secondary school students do their homework with the help of artificial intelligence? - A survey of attitudes towards artificial intelligence. Computers and Education: Artificial Intelligence, 8, Article 100394. https://doi.org/10.1016/j.caeai.2025.100394 [Google Scholar] [Crossref]

43. Villegas-Ch., W., Buenaño-Fernández, D., Navarro, A., & Mera-Navarrete, A. (2025). Adaptive intelligent tutoring systems for STEM education: analysis of the learning impact and effectiveness of personalized feedback. Smart Learning Environments, 12. https://doi.org/10.1186/s40561-025-00389-y [Google Scholar] [Crossref]

44. Walkington, C. A. (2025). The implications of generative artificial intelligence for mathematics education. School Science and Mathematics. https://doi.org/10.1111/ssm.18356 [Google Scholar] [Crossref]

45. Walter, Y. (2024). Embracing the future of Artificial Intelligence in the classroom: the relevance of AI literacy, prompt engineering, and critical thinking in modern education. International Journal of Educational Technology in Higher Education, 21, 1-29. https://doi.org/10.1186/s41239-024-00448-3 [Google Scholar] [Crossref]

46. Wardat, Y., Tashtoush, M. A., AlAli, R., & Jarrah, A. M. (2023). ChatGPT: A revolutionary tool for teaching and learning mathematics. EURASIA Journal of Mathematics, Science and Technology Education, 19(7), Article em2286. https://doi.org/10.29333/ejmste/13272 [Google Scholar] [Crossref]

47. Wijaya, T., Chen, X., & Purnama, S. (2026). Evaluating design thinking in mathematics students: The impact of AI utilization and digital literacy. Journal of Innovation in Education and Learning, 2(1), 27-40. https://doi.org/10.66031/jinea.v2i1.161 [Google Scholar] [Crossref]

48. Xing, W., Song, Y., Li, C., Liu, Z., Zhu, W., & Oh, H. (2025). Development of a generative AI-powered teachable agent for middle school mathematics learning: A design-based research study. British Journal of Educational Technology, 56, 2043–2077. https://doi.org/10.1111/bjet.13586 [Google Scholar] [Crossref]

49. Xue, L., Mahat, J., & Ghazali, N. (2026). Technology acceptance model in artificial intelligence in education: A meta-analysis. SAGE Open, 1-23. https://doi.org/10.1177/21582440251409441 [Google Scholar] [Crossref]

50. Yi, L., Liu, D., Jiang, T., & Xian, Y. (2025). The effectiveness of AI on K-12 students’ mathematics learning: A systematic review and meta-analysis. International Journal of Science and Mathematics Education, 23, 1105–1126. https://doi.org/10.1007/s10763-024-10499-7 [Google Scholar] [Crossref]

51. Yim, I. H. Y., & Su, J. (2024). Artificial intelligence (AI) learning tools in K-12 education: A scoping review. Journal of Computers in Education, 1-39. https://doi.org/10.1007/s40692-023-00304-9 [Google Scholar] [Crossref]

52. Zhai, C., Wibowo, S., & Li, L. D. (2024). The effects of over-reliance on AI dialogue systems on students' cognitive abilities: A systematic review. Smart Learning Environments, 11(28). https://doi.org/10.1186/s40561-024-00316-7 [Google Scholar] [Crossref]

• Assessment of the Role of Artificial Intelligence in Repositioning TVET for Economic Development in Nigeria
• Teachers’ Use of Assure Model Instructional Design on Learners’ Problem Solving Efficacy in Secondary Schools in Bungoma County, Kenya
• “E-Booksan Ang Kaalaman”: Development, Validation, and Utilization of Electronic Book in Academic Performance of Grade 9 Students in Social Studies
• Analyzing EFL University Students’ Academic Speaking Skills Through Self-Recorded Video Presentation
• Major Findings of The Study on Total Quality Management in Teachers’ Education Institutions (TEIs) In Assam – An Evaluative Study