The Influence of Chatgpt on Discourse & Content Knowledge

ChatGPT is an artificial intelligence language model that generates human-like text based on user input. It is trained on large datasets and produces clear and relevant responses, making it a useful tool for studying discourse and content knowledge. Its growing use in academic and communication settings influences how users construct meaning, understand information, and produce written texts. This study examines the influence of ChatGPT on discourse knowledge and content knowledge in writing within educational contexts. A quantitative approach was employed using a 5-point Likert-scale survey comprising four sections: demographic profile (2 items), discourse knowledge (10 items), content knowledge (17 items), and ChatGPT use (16 items). A total of 165 students from two Malaysian public universities, enrolled in German as a third language or as an elective, participated in the study. The findings show that ChatGPT improves students’ engagement, critical thinking, and writing performance. However, it has no significant effect on content knowledge and discourse knowledge, as these depend more on learners’ cognitive processes and prior knowledge. The results also show that gender does not significantly influence the use of ChatGPT or its relationship with writing knowledge. Overall, ChatGPT supports the writing process, but deeper writing development depends mainly on learner-related factors. Therefore, ChatGPT should be used as a supportive tool in teaching rather than as a replacement for cognitive and pedagogical development.

ChatGPT, Language Learning, Writing Performance, Content Knowledge, Discourse Knowledge

1. Abbas, M., Jam, F. A., & Khan, T. I. (2024). Is it harmful or helpful? Examining the causes and consequences of generative AI usage among university students. International Journal of Educational Technology in Higher Education, 21, Article 10. https://doi.org/10.1186/s41239-024-00444-7 [Google Scholar] [Crossref]

2. Abdallah, N., Katmah, R., Khalaf, K., & Jelinek, H. F. (2025). Systematic review of ChatGPT in higher education: Navigating impact on learning, wellbeing, and collaboration. Social Sciences & Humanities Open, 12, 100–115. [Google Scholar] [Crossref]

3. Adhikari, C., Das, P. K., & Das Biswas, S. (2025). AI in higher education: An analysis of ChatGPT's impact on scholarly communication. Educational Point, 2(2), 45–58. [Google Scholar] [Crossref]

4. Ahmad, N., Alias, F.A., Hamat, M., & Mohamed, S.A. (2024) Reliability Analysis: Application of Cronbach’s Alpha in Research Instruments. SIG: e-L earning@CS, 114-119. https://appspenang.uitm.edu.my/sigcs/ [Google Scholar] [Crossref]

5. Alexander, P. A. (2003). The development of expertise: The journey from acclimation to proficiency. Educational Researcher, 32(8), 10–14. [Google Scholar] [Crossref]

6. Bereiter, C., & Scardamalia, M. (1987). The psychology of written composition. Lawrence Erlbaum Associates, Inc. [Google Scholar] [Crossref]

7. Bhat, A., Agashe, S., Mohile, N., Oberoi, P., Jangir, R., & Joshi, A. (2022). Interacting with next-phrase suggestions: How suggestion systems aid and influence the cognitive processes of writing. arXiv. https://doi.org/10.48550/arXiv.2208.00636 [Google Scholar] [Crossref]

8. Baidoo-Anu, D., & Ansah, L. O. (2023). Education in the era of generative artificial intelligence (AI): Understanding the potential benefits of ChatGPT in promoting teaching and learning. Journal of AI, 7(1), 52–62. [Google Scholar] [Crossref]

9. Bereiter, C., & Scardamalia, M. (1987). The psychology of written composition. Lawrence Erlbaum Associates. [Google Scholar] [Crossref]

10. Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2023). Chatting and cheating? Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 61(2), 228–239. https://doi.org/10.1080/14703297.2023.2190148 [Google Scholar] [Crossref]

11. Cheng, S., Lin, C., Wei, D., & Chen, Y. (2026). A longitudinal psychological model of writing development: interactions among self-efficacy, regulation, and anxiety. Frontiers in Psychology, 17, 1757045. https://doi.org/10.3389/fpsyg.2026.1757045 [Google Scholar] [Crossref]

12. Ding, L., Zou, D., & Kohnke, L. (2025). ChatGPT as an automated writing evaluation tool: How students perceive it and how it affects their writing. Education and Information Technologies, 30, 26777–26799. https://doi.org/10.1007/s10639-025-13775-3 [Google Scholar] [Crossref]

13. Dahlkemper, M. N., Lahme, S. Z., & Klein, P. (2023). How do physics students evaluate artificial intelligence responses on comprehension questions? A study on the perceived scientific accuracy and linguistic quality. [Google Scholar] [Crossref]

14. He, L. (2024) The Application of SPSS Correlation Analysis in the Study if Precision Teaching of English in Universities. Applied Mathematics and Nonlinear Science, 9(1), 1-13. http://dx.doi.org/10.2478/amns-2024-1371 [Google Scholar] [Crossref]

15. Hyland, K. (2009). Academic discourse: English in a global context. Continuum. [Google Scholar] [Crossref]

16. Jiao, W., Wang, W., Huang, J. T., Wang, X., & Tu, Z. (2023). Is ChatGPT a good translator? Yes with GPT-4 as the engine. arXiv. https://arxiv.org/abs/2301.08745 [Google Scholar] [Crossref]

17. Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeiffer, F., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., & Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274 [Google Scholar] [Crossref]

18. Khairuddin,Z, Rahmat, N.H., Noor, M.M., & Khairuddin,Z. (2021) The Use of Rhetorical Strategies in Argumentative Essays. Pertanika Journal of Social Sciences & Humanities, 29(S3), 263-285). https://doi.org/10.47836/pjssh.29.S3.14 [Google Scholar] [Crossref]

19. Khampusaen, D. (2024). The impact of ChatGPT on academic writing skills and knowledge: An investigation of its use in argumentative essays. LEARN Journal: Language Education and Acquisition Research Network, 18(1), 963–988. [Google Scholar] [Crossref]

20. Kasneci, E., et al. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. [Google Scholar] [Crossref]

21. Lo, C. K., Hew, K. F., & Jong, M. S.-Y. (2024). The influence of ChatGPT on student engagement: A systematic review and future research agenda. Computers & Education, 219, 105100. https://doi.org/10.1016/j.compedu.2024.105100 [Google Scholar] [Crossref]

22. Mahapatra, S. (2024). Impact of ChatGPT on ESL students’ academic writing skills: A mixed methods intervention study. Smart Learning Environments, 11, Article 9. https://doi.org/10.1186/s40561-024-00295-9 [Google Scholar] [Crossref]

23. Meniado, J. C., Huyen, D. T. T., Panyadilokpong, N., & Lertkomolwit, P. (2024). Using ChatGPT for second language writing: Experiences and perceptions of EFL learners in Thailand and Vietnam. Computers and Education: Artificial Intelligence, 7, Article 100313. https://doi.org/10.1016/j.caeai.2024.100313 [Google Scholar] [Crossref]

24. Pham,V.P.H.(2021). The effects of collaborative writing on students’ writing performance. SAGE Open. [Google Scholar] [Crossref]

25. Palani, K., & Sulaiman, N. A. (2022). A systematic review: Strategies to reduce writing apprehension. International Journal of Academic Research in Progressive Education and Development, 11(3), 1740–1765. https://doi.org/10.6007/IJARPED/v11-i3/14938 [Google Scholar] [Crossref]

26. Pintrich, P. R., & De Groot, E. V. (1990). Motivational and self-regulated learning components of classroom academic performance. Journal of Educational Psychology, 82(1), 33–40. https://doi.org/10.1037/0022-0663.82.1.33 [Google Scholar] [Crossref]

27. Pintrich, P. R. (2000). The role of goal orientation in self-regulated learning. In Handbook of Self-Regulation. [Google Scholar] [Crossref]

28. Rahmat,N.H. (2021) An Investigative Study of Cognitive and Metacognitive Paraphrasing Strategies in ESL Writing. International Journal of Academic Research in Business & Social Sciences, 11(3), 76-87. http://dx.doi.org/10.6007/IJARBSS/v11-i3/8919 [Google Scholar] [Crossref]

29. Raoofi, S. Miri,A., Gharibi,J. & Malaki, B. (2017). Assessing and Validating a Writing Strategy Scale for Undergraduate Students. Journal of Language Teaching and Research, Vol 8(3), pp 624-633. Retrieved from http://www.academypublication.com/issues2/jltr/vol08/03/23.pdf [Google Scholar] [Crossref]

30. Rahman, M. M., & Watanobe, Y. (2023). ChatGPT for education and research: Opportunities, threats, and strategies. Applied Sciences, 13(9), 5783.https://doi.org/10.3390/app13095783 [Google Scholar] [Crossref]

31. Shah, M. A. (2024). Meaning and Statistical Analysis of T-Tests in SPSS. Journal of Saidu Medical College, 14(1), 64-65. https://doi.org/10.522006 [Google Scholar] [Crossref]

32. Shulman, L. S. (1986). Those who understand: Knowledge growth in teaching. Educational Researcher, 15(2), 4–14. https://doi.org/10.3102/0013189X015002004 [Google Scholar] [Crossref]

33. Teng, M. F. (2024). “ChatGPT is the companion, not enemies”: EFL learners’ perceptions and experiences in using ChatGPT for feedback in writing. Computers and Education: Artificial Intelligence, 7, Article 100270. https://doi.org/10.1016/j.caeai.2024.100270 [Google Scholar] [Crossref]

34. Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023). What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learning Environments, 10(1), 15. https://doi.org/10.1186/s40561-023-00237-x [Google Scholar] [Crossref]

35. Urban, M., Brom, C., Lukavský, J., Děchtěrenko, F., Hein, V., Švácha, F., Kmoníčková, P., & Urban, K. (2025). “ChatGPT can make mistakes. Check important info.” Epistemic beliefs and metacognitive accuracy in students’ integration of ChatGPT content into academic writing. British Journal of Educational Technology, 56(5), 1897–1918. https://doi.org/10.1111/bjet.13591 [Google Scholar] [Crossref]

36. Vetter, T.R. (2017) Descriptive Statistics: Reporting the Answers to the 5 Basic Questions of Who, What, Why, When , Where, and a Sixth, so What? Anesth Analg, 12595), 1797-1802. https://doi.org/10.1213/ane.0000000000002471 [Google Scholar] [Crossref]

37. Wang, J., & Fan, W. (2025). The effect of ChatGPT on students’ learning performance, learning perception, and higher-order thinking: Insights from a meta-analysis. Humanities and Social Sciences Communications, 12, Article 621. https://doi.org/10.1057/s41599-025-04787-y [Google Scholar] [Crossref]

38. Youssef,E., Medhat,M., Abdellatif,S., & Al Malek,M. (2024) Examining the effect of ChatGPT usage on students’ academic learning and achievement: A survey-based study in Ajman,UAE. Computers and Education: Artificial Intelligence, 7(Dec 2024), 100316. https://doi.org/10.1016/j.caeai.2024.100316 [Google Scholar] [Crossref]

39. Youssef, E., Medhat, M., Abdellatif, S., & Al Malek, M. (2024). Examining the effect of ChatGPT usage on students’ academic learning and achievement: A survey-based study in Ajman, UAE. Computers and Education: Artificial Intelligence, 7, 100316. https://doi.org/10.1016/j.caeai.2024.100316 [Google Scholar] [Crossref]

40. Ziegenfuss, J. Y., Casey A. E., Jennifer M. D., Meghan M. J., Thomas E. K, and Marna, C.. (202) Impact of Demographic Survey Questions on Response Rate and Measurement: A Randomized Experiment. Survey Practice 14 (1), https://doi.org/10.29115/SP-2021-0010. [Google Scholar] [Crossref]

41. Zimmerman, B. J. (2002). Becoming a self-regulated learner: An overview. Theory Into Practice, 41(2), 64–70. [Google Scholar] [Crossref]

• Assessment of the Role of Artificial Intelligence in Repositioning TVET for Economic Development in Nigeria
• Teachers’ Use of Assure Model Instructional Design on Learners’ Problem Solving Efficacy in Secondary Schools in Bungoma County, Kenya
• “E-Booksan Ang Kaalaman”: Development, Validation, and Utilization of Electronic Book in Academic Performance of Grade 9 Students in Social Studies
• Analyzing EFL University Students’ Academic Speaking Skills Through Self-Recorded Video Presentation
• Major Findings of The Study on Total Quality Management in Teachers’ Education Institutions (TEIs) In Assam – An Evaluative Study