Review: Study of Generative Pre-Trained Transformers (GPT) Approach Used in Various Application Domains.

Generative Pre-trained Transformer (GPT) are large language models that have transformed natural language processing by enabling machines to understand and generate human-like text. This paper presents a comprehensive review of GPT models and their applications across multiple domains, including education, healthcare, cybersecurity, finance, sentiment analysis, and academic research.

GPT, LLM, ChatGPT, NLP

1. https://cloud.google.com/discover/what-is-gpt [Google Scholar] [Crossref]

2. “A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4” , Katikapalli Subramanyam Kalyan Akmmus AI, arXiv:2310.12321v1 [cs.CL] 4 Oct 2023. [Google Scholar] [Crossref]

3. “Academic Writing with GPT-3.5 (ChatGPT): Reflections on Practices, Efficacy and Transparency “,Oğuz ‘Oz’ Buruk ,Mindtrek ’23, October 03–06, 2023, Tampere, Finland © 2023 Copyright held by the owner/author(s). ACM ISBN 979-8-4007-0874-9/23/10. https://doi.org/10.1145/3616961.3616992 [Google Scholar] [Crossref]

4. “Study and Analysis of Chat GPT and its Impact on Different Fields of Study “,Dinesh Kalla ,Nathan Smith ,Dr. Sivaraju Kuraku , Fnu Samaah ,International Journal of Innovative Science and Research Technology, ISSN No:-2456-2165,Volume 8, Issue 3, March – 2023 [Google Scholar] [Crossref]

5. “A Review of ChatGPT and its Impact in Different Domains “, Sakshi Aggarwal, International Journal of Applied Engineering Research ISSN 0973-4562 Volume 18, Number 2 (2023) pp. 119-123© Research India Publications. https://dx.doi.org/10.37622/IJAER/18.2.2023.119-123 [Google Scholar] [Crossref]

6. “The Rise of GPT-3: Implications for Natural Language Processing and Beyond “, Rahib Imamguluyev, International Journal of Research Publication and Reviews, Vol 4, no 3, pp 4893-4903 March 2023 [Google Scholar] [Crossref]

7. “Generative Pre-Trained Transformer (GPT) in Research: A Systematic Review on Data Augmentation “ , Fahim Sufi, Information 2024, 15, 99. https://doi.org/10.3390/info15020099 [Google Scholar] [Crossref]

8. “Short answer scoring with GPT-4 “, Lan Jiang, Nigel Bosch, L@S ’24, July 18–20, 2024, Atlanta, GA, USA © 2024 Copyright held by the owner/author(s). ACM ISBN 979-8-4007-0633-2/24/07 https://doi.org/10.1145/3657604.3664685 [Google Scholar] [Crossref]

9. “PAC-GPT: A Novel Approach to Generating Synthetic Network Traffic With GPT-3 “,DANIAL KHOSH KHOLGH AND PANOS KOSTAKOS,2023 The Authors. This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see https://creativecommons.org/licenses/by/4.0/ [Google Scholar] [Crossref]

10. “A New Approach to Web Application Security: Utilizing GPT Language Models for Source Code Inspection “,Zoltán Szabó and Vilmos Bilick, Future Internet 2023, 15, 326. https://doi.org/10.3390/fi15100326 https://www.mdpi.com/journal/futureinterne [Google Scholar] [Crossref]

11. “GPT is an effective tool for multilingual psychological text analysis “,Steve Rathjea,Dan-Mircea Mireab, Ilia Sucholutskyc , Raja Marjiehb , Claire E. Robertsona , and Jay J. Van Bavel, Downloaded from https://www.pnas.org by 103.4.233.29 on February 10, 2025 from IP address 103.4.233.29. ,PNAS  2024  Vol. 121  No. 34 e2308950121 ,https://doi.org/ 10.1073/pnas.2308950121 [Google Scholar] [Crossref]

12. “The Role of GPT Chat in Writing Scientific Articles: A Systematic Literature Review”,Ruth Megawati1, Hanida Listiani, Nuridin Widya Pranoto, Maik Akobiarek, Ruth rize Paas Megahati S,Jurnal Penelitian Pendidikan IPA (JPPIPA) November 2023, Volume 9 Issue 11, 1078-1084. https://doi.org/10.29303/jppipa.v9i11.5559 [Google Scholar] [Crossref]

13. “Performance of ChatGPT 3.5 and 4 as a tool for patient support before and after DBS surgery for Parkinson’s disease “,Ana Lúcia Oliveira,Miguel Coelho, Leonor Correia Guedes,Maria Begoña Cattoni,Herculano Carvalho, Pedro Duarte-Batista,Received: 4 June 2024 / Accepted: 19 August 2024 / Published online: 29 August 2024 © The Author(s) 2024,Neurological Sciences (2024) 45:5757–5764 https://doi.org/10.1007/s10072-024-07732-0 [Google Scholar] [Crossref]

14. “Harnessing the integration of chat GPT in higher education: the evaluation of stakeholders sentiments using NLP techniques”,Abdulaziz Altamimi ,16 August 2024 / Accepted: 17 December 2024 (2024) 5:509 | https://doi.org/10.1007/s43621-024-00774-6 [Google Scholar] [Crossref]

15. “Sentiment spin: Attacking financial sentiment with GPT-3 “,Markus Leippold, https://doi.org/10.1016/j.frl.2023.103957,Received 4 March 2023; Received in revised form 9 April 2023; Accepted 28 April 2023,Available online 5 May 2023 [Google Scholar] [Crossref]

16. “Performance of the pre trained large language model GPT 4 on automated short answer grading “, Gerd Kortemeyer, Received: 9 December 2023 / Accepted: 25 June 2024© The Author(s) 2024. [Google Scholar] [Crossref]

17. “The general intelligence of GPT–4, its knowledge diffusive and societal influences, and its governance “,Mohammad Mahdi Jahani Yekta, https://doi.org/10.1016/j.metrad.2024.100078 Received 16 January 2024; Received in revised form 17 March 2024; Accepted 19 March 2024,Available online 28 March 2024 [Google Scholar] [Crossref]

18. “Evaluation of GPT-3 AI Language Model in Research Paper Writing”, Oğuzhan KATAR, Dilek ÖZKAN, GPT-3, Özal YILDIRIM*, U Rajendra Acharya,Turkish Journal of Science & Technology Research Paper 18(2), 311-318, 2023. https://doi.org/10.55525/tjst.1272369 [Google Scholar] [Crossref]

19. “Book GPT: An Innovative PDF Querying Tool “,D.SANTHAKUMAR, L.SASIKALA, A.BALAJEE,International Journal of Pharmacy Research & Technology | Jan - May 2024 | Vol 14 | Issue 1 E-ISSN 2250-0944,ISSN 2250-1150 [Google Scholar] [Crossref]

20. “A GPT-Based Approach for Sentiment Analysis and Bakery Rating Prediction”, Diego Magdaleno, Martin Montes, Blanca Estrada, and Alberto Ochoa-Zezzatti,Chapter in Lecture Notes in Computer Science · February 2024 DOI: 10.1007/978-3-031-51940-6_7 [Google Scholar] [Crossref]

21. “Improving Language Understanding by Generative Pre-Training “,Alec Radford , Karthik Narasimhan, Tim Salimans, Ilya Sutskever,https://gluebenchmark.com/leaderboard [Google Scholar] [Crossref]

22. “ZzzGPT: An Interactive GPT Approach to Enhance Sleep Quality “,Yonchanok Khaokaew ,Kaixin Ji ,Thuc Hanh Nguyen,Hiruni Kegalle, Marwah Alaofi,Hao Xue, Flora D. Salim,arXiv:2310.16242v2 [cs.LG] 7 May 2024 [Google Scholar] [Crossref]

23. “A comparison of Human, GPT-3.5, and GPT-4 Performance in a University-Level Coding Course “,arXiv:2403.16977v1 [cs.CL] 25 Mar 2024 ,https://github.com/WillYeadon/AI-Exam-Completion [Google Scholar] [Crossref]

24. “EVALUATING GPT-4 AT GRADING HANDWRITTEN SOLUTIONS IN MATH EXAMS “,Adriana Caraeni ,Alexander Scarlatos,Andrew Lan ,arXiv:2411.05231v1 [cs.CY] 7 Nov 2024 [Google Scholar] [Crossref]

25. "QuestionAnsweringforComparativeQuestions withGPT-2",Bjarne Sievers , Copyright c 2020 for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). CLEF 2020, 22-25 September 2020,Thessaloniki, Greece.https://www.coursera.org/articles/what-is-gpt27) [Google Scholar] [Crossref]

• What the Desert Fathers Teach Data Scientists: Ancient Ascetic Principles for Ethical Machine-Learning Practice
• Comparative Analysis of Some Machine Learning Algorithms for the Classification of Ransomware
• Comparative Performance Analysis of Some Priority Queue Variants in Dijkstra’s Algorithm
• Transfer Learning in Detecting E-Assessment Malpractice from a Proctored Video Recordings.
• Dual-Modal Detection of Parkinson’s Disease: A Clinical Framework and Deep Learning Approach Using NeuroParkNet